-- Logs begin at Thu 2022-08-04 04:11:09 UTC, end at Thu 2022-08-04 05:46:24 UTC. -- Aug 04 05:04:47.333750 dv-cinder-852072-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 04 05:04:47.344476 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 05:04:47 2022] *** Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: nodename: dv-cinder-852072-1-iscsi Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: machine: x86_64 Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: clock source: unix Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: pcre jit disabled Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: detected number of CPU cores: 4 Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: current working directory: / Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: detected binary path: /usr/bin/uwsgi-core Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: your processes number limit is 47680 Aug 04 05:04:47.346484 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: your memory page size is 4096 bytes Aug 04 05:04:47.347199 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: detected max file descriptor number: 2048 Aug 04 05:04:47.347199 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: lock engine: pthread robust mutexes Aug 04 05:04:47.347199 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: thunder lock: enabled Aug 04 05:04:47.347199 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 04 05:04:47.347199 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 05:04:47.387044 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: Python main interpreter initialized at 0x562ef167e9c0 Aug 04 05:04:47.387044 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: python threads support enabled Aug 04 05:04:47.387044 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: your server socket listen backlog is limited to 100 connections Aug 04 05:04:47.387044 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: your mercy for graceful operations on workers is 90 seconds Aug 04 05:04:47.387644 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 05:04:47.387644 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: *** Operational MODE: preforking *** Aug 04 05:04:47.387798 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: *** uWSGI is running in multiple interpreter mode *** Aug 04 05:04:47.387798 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: spawned uWSGI master process (pid: 80687) Aug 04 05:04:47.387942 dv-cinder-852072-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 04 05:04:47.394335 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: spawned uWSGI worker 1 (pid: 80698, cores: 1) Aug 04 05:04:47.394335 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: spawned uWSGI worker 2 (pid: 80699, cores: 1) Aug 04 05:04:47.394335 dv-cinder-852072-1-iscsi devstack@keystone.service[80687]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 05:04:52.967274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:04:52.967274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: from cryptography.utils import int_from_bytes Aug 04 05:04:52.968083 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:04:52.968083 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: from cryptography.utils import int_from_bytes Aug 04 05:04:52.968528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:04:52.968528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: from cryptography.utils import int_from_bytes Aug 04 05:04:52.968674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:04:52.968674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: from cryptography.utils import int_from_bytes Aug 04 05:04:53.018093 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 05:04:53.018267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 05:04:53.018381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 05:04:53.018462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 05:04:53.018531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] command line args: [] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 05:04:53.018594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] command line args: [] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 05:04:53.018740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 05:04:53.018833 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 05:04:53.018911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ================================================================================ {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 05:04:53.018992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ================================================================================ {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 05:04:53.019140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] admin_token = **** {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.019219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] admin_token = **** {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.019385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] config_dir = [] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.019470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] config_dir = [] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.019570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.019659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.019754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] config_source = [] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.019833 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] config_source = [] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.019913 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] debug = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.019990 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] debug = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.020113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.020426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.020552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.020653 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.020754 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.020857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.020953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.021051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.021152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.021251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.021346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] list_limit = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.021448 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] list_limit = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.021549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] log_config_append = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.021648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] log_config_append = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.021741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.021839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.021933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] log_dir = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.022039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] log_dir = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.022133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] log_file = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.022231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] log_file = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.022359 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.022489 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.022616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.022738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.022818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.022928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023193 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.023967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.024042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.024156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.024229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.024351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.024432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.024551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.024626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.024738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.024825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.024942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.025029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.025212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.025290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.025698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.025878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.025995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] publish_errors = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.026068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] publish_errors = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.026189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.026263 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.026402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.026483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.026603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.026682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.026806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.026900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.026971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.027090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.027170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] standard_threads = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.027242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] standard_threads = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.027381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.027460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] use_journal = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028427 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] use_journal = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] use_json = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] use_json = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] use_stderr = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] use_stderr = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] use_syslog = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.028982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] use_syslog = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.029053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.029120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:04:53.029196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.029268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.029336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.029403 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.029523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.029604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.029683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.029753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.029830 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.029904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.029979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.030107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.030223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.030372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.030463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.030609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.030694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.030856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.030940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.031101 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.031185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.031346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.031424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.031578 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.031664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.031822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.031905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.032056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.032133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.032295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.032381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.032529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.032606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.032760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.032879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.033001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.033121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.033240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.033353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.033464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.033583 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.033767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.033882 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.034008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.034122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.034233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.034362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.034493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.034610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.034729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.034842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.034954 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.035065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.035185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.035298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.035415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.035534 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.035653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.035765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.035884 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.035998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.036115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.036227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.036345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.036457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.036576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.036691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.036808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.036920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.037016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.037107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.037266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.037368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.037461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.037561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.037698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.037803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.037907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.038003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.038132 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.038254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.038396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.038512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.038633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.038747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.038868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.038982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.039097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.039210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.039335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.039451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.039580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.039695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.039808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.039921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.040033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.040156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.040270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.040389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.040508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.040622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.040743 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.040866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.040980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.041083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.041194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.041307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.041432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.041555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.041670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.041773 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.041886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.042005 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.042118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.042229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.042388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.042513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.042628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.042741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.042860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.043492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.043681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.044123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.044240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.044368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.044485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.044610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.044726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.044726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.044950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.045065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.045179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.045300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.045415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.045528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.045641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.045754 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.045867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.046054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.046173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.046287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.046417 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.046531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.046644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.046770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.046887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.046999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.047120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.047484 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.047600 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.047726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.047853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.047969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.048089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.048204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.048318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.048431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.048553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.048674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.048798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.048913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.049034 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.049148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.049274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.049389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.049503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.049616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.049729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.049842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.049963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.050078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.050192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.050358 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.050475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.050599 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.050726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.050841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.050954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.051067 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.051180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.051293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.051414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.051529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.051664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.051778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.051891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.052004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.052124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.052239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.052353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.052466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.052579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.052691 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.052813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.052934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.053048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.053161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.053274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.053387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.053509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.053623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.053743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.053863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.053977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.054090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.054212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.054340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] auth.external = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.054456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.054569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.054680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.054793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.054923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] auth.external = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.055043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.055179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.055306 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] auth.password = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.055422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.055537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] auth.token = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.055651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.055764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.055886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] auth.password = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.056001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.056115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] auth.token = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.056228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.056342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.056455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.056578 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.056693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.056807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.056921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.057034 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.057154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.057277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.057392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] credential.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.057506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.057620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.057734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.057847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.057970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] credential.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.058085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.058199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.058340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.058461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.058576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.059308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.059844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.059965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.060081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.060195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.060309 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.060445 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.060569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.060685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.060801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.060915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.061028 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.061216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.061341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.061463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.061579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.061692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.061807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.061929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.062045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.062158 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.062272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] federation.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.062471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.062604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.062721 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.062835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.062940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] federation.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.063058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.063173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.063295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.063411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.063524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.063638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.063752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.063865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.063988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.064103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.064218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.064331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.064444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.064566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.064689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.064805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.064920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.065033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.065146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.065259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.065381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.065496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.065610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.065610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.065824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.065937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.066060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.066175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.066289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.066423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.066538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.066652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.066778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.066894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.067009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.067123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.067237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.067350 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.067472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.067587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.067701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.067823 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.067938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.068052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.068175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.068290 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.068404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.068518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.068632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.068632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.068854 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.068970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.069088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.069210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.069326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.069440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.069563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.069563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.069768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.069881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.069995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.070108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.070231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.070384 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.070500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.070614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.070727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.070841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.070970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.071086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.071200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.071321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.071442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.071564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.071679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.071679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.071892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.072007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.072120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.072242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.072357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.072471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.072585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.072699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.072818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.072944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.073059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.073172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.073292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.073292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.073506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.073506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.073729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.073729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.073942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.073942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.074155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.074155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.074952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.075079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.075208 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.075326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.075442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.075442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.075666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.075666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.075879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.075992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.076105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.076227 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.076342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.076456 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.076570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.076682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.076796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.076917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.077033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.077033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.077245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.077359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.077473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.077596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.077711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.077824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.077937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.078050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.078163 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.078285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.078454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.078570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.078684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.078798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.078911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.079038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.079154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.079268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.079387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.079501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.079615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.079742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.079859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.079973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.080087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.080201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.080315 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.080437 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.080552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.080667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.080781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.080895 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.081009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.081131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.081247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.081361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.081475 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.081589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.081703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.081827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.081942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.082057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.082172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.082286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.082435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.082566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.082682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.082797 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.082910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.083023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.083142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.083266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.083380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.083494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.083607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.083720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.083834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.084023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.084147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.084261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.084375 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.084488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.084600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.084723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.084838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.084952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.085065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.085179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.085292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.085413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.085528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.085641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.085754 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.085868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.085981 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.086104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.086218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] resource.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.086377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.086494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.086618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.086733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.086857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] resource.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.086973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.087086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.087199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.087313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.087435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.087550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.087664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.087777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.087890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.088005 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.088126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.088242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.088355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.088468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.088581 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] role.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.088701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.088824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] role.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.088940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.089057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.089172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] role.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.089291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.089406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] role.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.089528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.089643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.089756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.089890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.090074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.090580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.090717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.090835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.090950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.091064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.091180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.091294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.091416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.091538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.091654 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.091767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.091880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.091994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.092116 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.092233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.092346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.092460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.092574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.092687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.092687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.092912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.093026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.093140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.093140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.093354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.093476 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.093590 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.093704 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.093818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.093932 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.094055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.094170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.094283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.094418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.094533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.094533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.094761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.094761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.094977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.095091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.095206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.095320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.095447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.095563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.095677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.095791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.095905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.096019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.096142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.096257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.096372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.096486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.096601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.096714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.096836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.096951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.097066 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.097179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] token.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.097293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.097407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.097530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.097645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.097760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] token.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.097874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.097988 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.098101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.098224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.098385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.098503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.098618 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.098732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.098845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.098972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.099088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.099206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.099319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.099432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.099546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.099667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.099782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.099895 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.100008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.100121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.100234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.100358 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.100473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.100587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.100700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.100813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.100925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.101047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.101162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.101276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.101276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.101487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.connection = **** {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.101487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.101719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.101842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.101958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.connection = **** {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.102079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.102202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.102335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.102450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.102564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.102676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.102866 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.102984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.103098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.103211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.103323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.103436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.103557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.103672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.103787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.103939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.104054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.104168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.104292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.104407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.104522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.104636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.104750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.104865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.104992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.105117 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.105233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.105348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.105462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.106076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.106703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.106827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.106944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 05:04:53.107060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.107060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:04:53.107060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 05:04:53.132487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.132633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.132766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.132845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.132918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.133010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.141291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.141548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.171955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.172188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.172701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.173210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.225036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.225415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.275214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.275383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.275527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.275611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.340861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.341068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.341153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.341289 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.341376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.341501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.341586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.341726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.341816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.341946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.342036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.342168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.365412 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.365577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.365665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.365810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.365893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.366036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.366121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.366257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.366356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.366493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.366576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.366700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.366784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.366911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.377691 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.378244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.390794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.391021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.391239 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.391454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.391577 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.391678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.391808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.391891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.392030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.392115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80698) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.392250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.392466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.392680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.392887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 05:04:53.409469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.409673 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 05:04:53.409776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.409893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 05:04:53.410004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.410202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 05:04:53.410282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.410433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 05:04:53.410518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.410698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.410782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.410956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.411037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.411205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.411286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.411453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.421473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.421744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.421849 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.422007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.422138 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.422558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.422645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.422849 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.429444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.429701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.434219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.434482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.434569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.434757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.434842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.435030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.435113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.435302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.435391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.435554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.435637 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.435810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.435987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.436070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.436154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.436321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.436403 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.436580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.436661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.436838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.436919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.437091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.459952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.460061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.461431 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.461522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.461702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.461785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.466844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.467049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.467148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.467325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.467408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.467603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.473961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.474366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.474463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.474545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.478357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.478595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.478691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.478868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.478952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.479150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.479233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.479431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.479524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.479707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.479788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.479975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.480060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.480238 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.480321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.481587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.496921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.497196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.497790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.498064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.501136 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.502015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.504358 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.504640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.505175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.505463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.509010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.509860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.512885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.513695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.516088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.516383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.516658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.516894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.516994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.517200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.517297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.517483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.517587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.517766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.518055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.518351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.534257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.534560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.534822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.534905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.535090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.535174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.535409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.535680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.541875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.542552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.544008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.544300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.544622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.544894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.547129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.547656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.547947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.548039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.548223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.548305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.548492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.548632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.548914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.549187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.560471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.560740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.561010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.561866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.561957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.562133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.562220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.562295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.562396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.562486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.562571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.562646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.562646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.562837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.578076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.579272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.581051 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.582262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.583988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.585214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.586584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.587811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.588082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.588356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.588640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.590956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.590956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.590956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.595675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.596851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.597256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.598526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.600179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.600463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.600737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.601000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.601427 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.601721 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.602000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.602268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.609349 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.609638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.609914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.610581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.610870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.611147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.616809 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.617085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.617364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.617632 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.617895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.618028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80698) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 05:04:53.618160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.618325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.618452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.618600 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.618736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.618868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.619115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.619196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.619383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.619473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.619648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.619730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.619916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.619999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.620183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.620302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.620445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.620577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.620844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.621147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.622076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.622438 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80698) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 05:04:53.654991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ef167e9c0 pid: 80699 (default app) Aug 04 05:04:53.656441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ef167e9c0 pid: 80698 (default app) Aug 04 05:04:53.658361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89644a-14c7-4fa7-bc1c-f65af69ee127 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:04:53.658650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89644a-14c7-4fa7-bc1c-f65af69ee127 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:04:53.658922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89644a-14c7-4fa7-bc1c-f65af69ee127 None None] PATH_INFO: `/v3` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:04:53.663169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Thu Aug 4 05:04:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:02.563237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae20e1e-90b5-46a9-94bc-5d00cd759fdf None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:02.563787 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae20e1e-90b5-46a9-94bc-5d00cd759fdf None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:02.563787 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae20e1e-90b5-46a9-94bc-5d00cd759fdf None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:02.568144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:02.573340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:02.573844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:02.573965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:02.643435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: INFO dbcounter [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] Registered counter for database keystone Aug 04 05:05:02.664926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG oslo_db.sqlalchemy.engines [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:05:02.671230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writer thread running {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:05:02.850973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG passlib.handlers.bcrypt [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80699) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 05:05:02.851311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG passlib.handlers.bcrypt [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80699) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 05:05:02.907013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:02.908617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:03.041903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 05:05:03.178090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae20e1e-90b5-46a9-94bc-5d00cd759fdf None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:03.248922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: INFO dbcounter [None req-9ae20e1e-90b5-46a9-94bc-5d00cd759fdf None None] Registered counter for database keystone Aug 04 05:05:03.268707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG oslo_db.sqlalchemy.engines [None req-9ae20e1e-90b5-46a9-94bc-5d00cd759fdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:05:03.275366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writer thread running {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:05:03.394136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae20e1e-90b5-46a9-94bc-5d00cd759fdf None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:03.398499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997b38d-581e-4bef-b843-b7d7654eed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:03.399133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997b38d-581e-4bef-b843-b7d7654eed08 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:03.399412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997b38d-581e-4bef-b843-b7d7654eed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:03.399684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997b38d-581e-4bef-b843-b7d7654eed08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:03.408371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997b38d-581e-4bef-b843-b7d7654eed08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:03.460598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c997b38d-581e-4bef-b843-b7d7654eed08 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 05:05:03.460857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997b38d-581e-4bef-b843-b7d7654eed08 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:03.474398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Thu Aug 4 05:05:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:05:03.480632 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:03.495714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e968a8-95d7-42e5-9079-4f6300beec1f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:03.500678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40b0a-89b1-4c7f-8741-b3a4ce720ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:03.501902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40b0a-89b1-4c7f-8741-b3a4ce720ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:03.502178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40b0a-89b1-4c7f-8741-b3a4ce720ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:03.502475 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40b0a-89b1-4c7f-8741-b3a4ce720ac2 admin admin] PATH_INFO: `/v3/projects/d0fa97262e904ea29696d2d9cb8b9bc3` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:03.503961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40b0a-89b1-4c7f-8741-b3a4ce720ac2 admin admin] RBAC: Authorizing `identity:get_project(project_id=d0fa97262e904ea29696d2d9cb8b9bc3)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:03.555578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: WARNING keystone.common.rbac_enforcer.enforcer [None req-61c40b0a-89b1-4c7f-8741-b3a4ce720ac2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 05:05:03.555915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40b0a-89b1-4c7f-8741-b3a4ce720ac2 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:03.560921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Thu Aug 4 05:05:03 2022] GET /identity/v3/projects/d0fa97262e904ea29696d2d9cb8b9bc3 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:05.623090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963e69-f21a-4292-8608-751120b5a10f None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:05.623819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963e69-f21a-4292-8608-751120b5a10f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:05.623819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963e69-f21a-4292-8608-751120b5a10f None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:05.627834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:05:05.633729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d5ae-52d6-454f-ae68-a99768f6d4f2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:05.634180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d5ae-52d6-454f-ae68-a99768f6d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:05.634426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d5ae-52d6-454f-ae68-a99768f6d4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:05.660293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-f105d5ae-52d6-454f-ae68-a99768f6d4f2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:05.662452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f105d5ae-52d6-454f-ae68-a99768f6d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:05.670852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 05:05:05.695387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08963e69-f21a-4292-8608-751120b5a10f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:05.711679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08963e69-f21a-4292-8608-751120b5a10f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:05.721240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fe48d-341e-4c09-b29c-1ac3ffb602b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:05.721240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe48d-341e-4c09-b29c-1ac3ffb602b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:05.721240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe48d-341e-4c09-b29c-1ac3ffb602b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:05.721240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe48d-341e-4c09-b29c-1ac3ffb602b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:05.727165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fe48d-341e-4c09-b29c-1ac3ffb602b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:05.730123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fe48d-341e-4c09-b29c-1ac3ffb602b3 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:05.741550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Thu Aug 4 05:05:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:05:05.748686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105d5ae-52d6-454f-ae68-a99768f6d4f2 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:05.760342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105d5ae-52d6-454f-ae68-a99768f6d4f2 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:05.766469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a812998-76a9-42fb-a39a-6ab948fdc52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:05.767316 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812998-76a9-42fb-a39a-6ab948fdc52c admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:05.767596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812998-76a9-42fb-a39a-6ab948fdc52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:05.767994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812998-76a9-42fb-a39a-6ab948fdc52c admin admin] PATH_INFO: `/v3/users/75b3532d53944d4789f9bd6bd6ab00cf` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:05.769795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a812998-76a9-42fb-a39a-6ab948fdc52c admin admin] RBAC: Authorizing `identity:get_user(user_id=75b3532d53944d4789f9bd6bd6ab00cf)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:05.771669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a812998-76a9-42fb-a39a-6ab948fdc52c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:05.779377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Thu Aug 4 05:05:05 2022] GET /identity/v3/users/75b3532d53944d4789f9bd6bd6ab00cf => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:07.852385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995da36-fbb6-4aa9-b849-b269026ddeb9 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:07.852929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995da36-fbb6-4aa9-b849-b269026ddeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:07.852929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995da36-fbb6-4aa9-b849-b269026ddeb9 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:07.854295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:07.859764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09293c-5a3b-4d07-b553-d20d52693595 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:07.860238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09293c-5a3b-4d07-b553-d20d52693595 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:07.860521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09293c-5a3b-4d07-b553-d20d52693595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:07.879615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-0d09293c-5a3b-4d07-b553-d20d52693595 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:07.880788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0d09293c-5a3b-4d07-b553-d20d52693595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:07.891033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d014acf-ebff-4c44-bedf-c0535adf5a03 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:07.891311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d014acf-ebff-4c44-bedf-c0535adf5a03 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:07.891581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d014acf-ebff-4c44-bedf-c0535adf5a03 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:07.892931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:05:07.897897 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a05f-5141-48b7-8169-2b57c666405a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:07.898181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a05f-5141-48b7-8169-2b57c666405a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:07.898494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a05f-5141-48b7-8169-2b57c666405a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:07.941579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG passlib.handlers.bcrypt [None req-b0e5a05f-5141-48b7-8169-2b57c666405a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80698) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 05:05:07.942000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG passlib.handlers.bcrypt [None req-b0e5a05f-5141-48b7-8169-2b57c666405a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80698) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 05:05:07.964879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:07.987798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09293c-5a3b-4d07-b553-d20d52693595 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:07.988784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b0e5a05f-5141-48b7-8169-2b57c666405a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:07.990381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b0e5a05f-5141-48b7-8169-2b57c666405a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:08.011420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:08.093034 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:08.095192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09293c-5a3b-4d07-b553-d20d52693595 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:08.114739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a05f-5141-48b7-8169-2b57c666405a None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:08.129660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd11b0-153b-4300-8d48-3084ae06916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:08.130320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd11b0-153b-4300-8d48-3084ae06916d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:08.130613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd11b0-153b-4300-8d48-3084ae06916d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:08.130892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd11b0-153b-4300-8d48-3084ae06916d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:08.142761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd11b0-153b-4300-8d48-3084ae06916d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-56dd11b0-153b-4300-8d48-3084ae06916d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:08.151592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:08.152486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:08.153369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:05:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:05:08.159626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd11b0-153b-4300-8d48-3084ae06916d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:08.219906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a05f-5141-48b7-8169-2b57c666405a None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:08.222212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:08.246288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:08.256874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f55645-eb6c-496a-a864-a70f3e9b2943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:08.257738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55645-eb6c-496a-a864-a70f3e9b2943 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:08.258020 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55645-eb6c-496a-a864-a70f3e9b2943 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:08.258301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55645-eb6c-496a-a864-a70f3e9b2943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:08.265770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd11b0-153b-4300-8d48-3084ae06916d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:08.299431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1545d1a-2992-4f67-b506-ece47883550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:08.300099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545d1a-2992-4f67-b506-ece47883550e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:08.300621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545d1a-2992-4f67-b506-ece47883550e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:08.300941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545d1a-2992-4f67-b506-ece47883550e None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:08.301838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1545d1a-2992-4f67-b506-ece47883550e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:08.302542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1545d1a-2992-4f67-b506-ece47883550e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:08.303926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1545d1a-2992-4f67-b506-ece47883550e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:08.317396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:08.322955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1545d1a-2992-4f67-b506-ece47883550e None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:08.329844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f55645-eb6c-496a-a864-a70f3e9b2943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:08.331393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f55645-eb6c-496a-a864-a70f3e9b2943 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:08.437743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 05:05:08.443728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f55645-eb6c-496a-a864-a70f3e9b2943 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:08.446946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:08.528955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1545d1a-2992-4f67-b506-ece47883550e None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:08.544886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f55645-eb6c-496a-a864-a70f3e9b2943 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:08.565105 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e16eb-ac08-401e-bdb4-c17fef62713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:08.565752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e16eb-ac08-401e-bdb4-c17fef62713c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:08.566033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e16eb-ac08-401e-bdb4-c17fef62713c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:08.566326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e16eb-ac08-401e-bdb4-c17fef62713c None admin] PATH_INFO: `/v3/users/75b3532d53944d4789f9bd6bd6ab00cf` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:08.567518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e16eb-ac08-401e-bdb4-c17fef62713c None admin] RBAC: Authorizing `identity:get_user(user_id=75b3532d53944d4789f9bd6bd6ab00cf)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:08.569025 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e16eb-ac08-401e-bdb4-c17fef62713c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:08.570645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:08 2022] GET /identity/v3/users/75b3532d53944d4789f9bd6bd6ab00cf => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:08.576453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e16eb-ac08-401e-bdb4-c17fef62713c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:08.581054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdb6de-36b3-4471-b026-7143b501b6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:08.581909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdb6de-36b3-4471-b026-7143b501b6ec None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:08.582188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdb6de-36b3-4471-b026-7143b501b6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:08.582478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdb6de-36b3-4471-b026-7143b501b6ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:08.590920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:08.600891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdb6de-36b3-4471-b026-7143b501b6ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:08.605776 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdb6de-36b3-4471-b026-7143b501b6ec None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-bcfdb6de-36b3-4471-b026-7143b501b6ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:05:08.620632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:08.621487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:08.623021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:05:08.623021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:05:08.623021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:05:08.623021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:08.623021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:05:08.628411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdb6de-36b3-4471-b026-7143b501b6ec None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:08.679094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e16eb-ac08-401e-bdb4-c17fef62713c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:08.687674 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:08.713566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f58ea-4362-466c-9386-463c04b533ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:08.714119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f58ea-4362-466c-9386-463c04b533ec None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:08.714454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f58ea-4362-466c-9386-463c04b533ec None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:08.714736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f58ea-4362-466c-9386-463c04b533ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:08.716030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f58ea-4362-466c-9386-463c04b533ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:08.717538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f58ea-4362-466c-9386-463c04b533ec None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:08.719159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:08.725040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f58ea-4362-466c-9386-463c04b533ec None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:08.734634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdb6de-36b3-4471-b026-7143b501b6ec None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:08.768824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d16150-0499-4989-86ba-0c818da30a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:08.769441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16150-0499-4989-86ba-0c818da30a64 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:08.769717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16150-0499-4989-86ba-0c818da30a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:08.769984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16150-0499-4989-86ba-0c818da30a64 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:08.770705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d16150-0499-4989-86ba-0c818da30a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:08.771001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d16150-0499-4989-86ba-0c818da30a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:08.772368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d16150-0499-4989-86ba-0c818da30a64 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:08.790057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:08.808718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:08.829810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f58ea-4362-466c-9386-463c04b533ec None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:08.867394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dc180-bafa-4fa6-b52c-6e125a90a34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:08.868075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dc180-bafa-4fa6-b52c-6e125a90a34e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:08.868287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dc180-bafa-4fa6-b52c-6e125a90a34e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:08.868608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dc180-bafa-4fa6-b52c-6e125a90a34e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:08.869371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dc180-bafa-4fa6-b52c-6e125a90a34e None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.domain.id=default, user.id=75b3532d53944d4789f9bd6bd6ab00cf) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:08.869727 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dc180-bafa-4fa6-b52c-6e125a90a34e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:08.871300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dc180-bafa-4fa6-b52c-6e125a90a34e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:08.879721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 11/21] 10.222.0.46 () {56 vars in 1322 bytes} [Thu Aug 4 05:05:08 2022] GET /identity/v3/role_assignments?user.id=75b3532d53944d4789f9bd6bd6ab00cf&scope.domain.id=default&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:11.220387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4f258-3b79-404e-9bad-d521059af779 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:11.221336 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4f258-3b79-404e-9bad-d521059af779 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:11.221828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4f258-3b79-404e-9bad-d521059af779 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:11.223396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:11.228832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da77a7-d7b3-4711-95f9-c4b9abbf8dbe None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:11.229248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da77a7-d7b3-4711-95f9-c4b9abbf8dbe None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:11.229382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da77a7-d7b3-4711-95f9-c4b9abbf8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:11.255302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e2da77a7-d7b3-4711-95f9-c4b9abbf8dbe None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:11.256745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e2da77a7-d7b3-4711-95f9-c4b9abbf8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:11.348531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:11.393150 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4f258-3b79-404e-9bad-d521059af779 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:11.402682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b0e5-e4f9-4019-935b-acf8981544d3 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:11.402973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b0e5-e4f9-4019-935b-acf8981544d3 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:11.403323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b0e5-e4f9-4019-935b-acf8981544d3 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:11.404741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:11.410120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74501b-dd07-40f3-ac1e-ed6e96851cc8 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:11.410710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74501b-dd07-40f3-ac1e-ed6e96851cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:11.411190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74501b-dd07-40f3-ac1e-ed6e96851cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:11.443599 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-0b74501b-dd07-40f3-ac1e-ed6e96851cc8 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:11.445143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0b74501b-dd07-40f3-ac1e-ed6e96851cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:11.609146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 14/25] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:11.610300 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4f258-3b79-404e-9bad-d521059af779 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:11.644563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74501b-dd07-40f3-ac1e-ed6e96851cc8 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:11.645198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:11.652360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:11.692150 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34882130-c212-49cb-a7d3-becd4f2528e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:11.692807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34882130-c212-49cb-a7d3-becd4f2528e9 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:11.693089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34882130-c212-49cb-a7d3-becd4f2528e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:11.693373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34882130-c212-49cb-a7d3-becd4f2528e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:11.719291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34882130-c212-49cb-a7d3-becd4f2528e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:11.720704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34882130-c212-49cb-a7d3-becd4f2528e9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-34882130-c212-49cb-a7d3-becd4f2528e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:05:11.738934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:11.739829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:11.740609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:05:11.740609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:05:11.740609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:05:11.740609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:11.741005 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 12/26] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:11.745414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac3bb-a34c-4029-9e92-f3f36ca51e13 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:11.745886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac3bb-a34c-4029-9e92-f3f36ca51e13 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:11.746297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac3bb-a34c-4029-9e92-f3f36ca51e13 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:11.753885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:11.755018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ac3bb-a34c-4029-9e92-f3f36ca51e13 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:11.835029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74501b-dd07-40f3-ac1e-ed6e96851cc8 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:11.870605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d1f2e-e42b-46f8-a42a-1e3e9bf236f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:11.871559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d1f2e-e42b-46f8-a42a-1e3e9bf236f9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:11.872524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d1f2e-e42b-46f8-a42a-1e3e9bf236f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:11.872938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d1f2e-e42b-46f8-a42a-1e3e9bf236f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:11.884923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d1f2e-e42b-46f8-a42a-1e3e9bf236f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:11.889271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ac3bb-a34c-4029-9e92-f3f36ca51e13 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-fe5d1f2e-e42b-46f8-a42a-1e3e9bf236f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:11.891436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:11.892458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:11.893394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:11.895647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 15/28] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:05:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:05:11.897365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a16b8-6e87-42db-8179-259e45660bb2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:11.897650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a16b8-6e87-42db-8179-259e45660bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:11.897922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a16b8-6e87-42db-8179-259e45660bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:11.918026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-600a16b8-6e87-42db-8179-259e45660bb2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:11.920389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-600a16b8-6e87-42db-8179-259e45660bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:11.943320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8926926-525b-46c6-8411-2fe396edb610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:11.944352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8926926-525b-46c6-8411-2fe396edb610 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:11.945294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8926926-525b-46c6-8411-2fe396edb610 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:11.945790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8926926-525b-46c6-8411-2fe396edb610 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:11.946993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8926926-525b-46c6-8411-2fe396edb610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:11.947717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8926926-525b-46c6-8411-2fe396edb610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:11.949982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8926926-525b-46c6-8411-2fe396edb610 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:11.965502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 14/29] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:11.968232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1e658-541e-4e09-a09d-a644eeed8e18 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:11.969124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1e658-541e-4e09-a09d-a644eeed8e18 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:11.969689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1e658-541e-4e09-a09d-a644eeed8e18 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:11.971918 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 15/30] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:11.972863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1e658-541e-4e09-a09d-a644eeed8e18 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:11.998179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:12.007545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 16/31] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:12.008747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a16b8-6e87-42db-8179-259e45660bb2 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:12.118419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:12.129466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a16b8-6e87-42db-8179-259e45660bb2 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:12.184860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb4209-e17d-4573-bfb3-62143aac067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:12.186089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb4209-e17d-4573-bfb3-62143aac067f None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:12.186466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb4209-e17d-4573-bfb3-62143aac067f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:12.186844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb4209-e17d-4573-bfb3-62143aac067f None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:12.187875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb4209-e17d-4573-bfb3-62143aac067f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:12.189709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb4209-e17d-4573-bfb3-62143aac067f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:12.207193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1e658-541e-4e09-a09d-a644eeed8e18 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:12.251933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd02a44-075d-4448-b5bc-fcccad6a3318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:12.252562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02a44-075d-4448-b5bc-fcccad6a3318 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:12.252883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02a44-075d-4448-b5bc-fcccad6a3318 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:12.253161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02a44-075d-4448-b5bc-fcccad6a3318 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:12.253870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd02a44-075d-4448-b5bc-fcccad6a3318 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:12.254170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd02a44-075d-4448-b5bc-fcccad6a3318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:12.255562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd02a44-075d-4448-b5bc-fcccad6a3318 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:12.269106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 16/32] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:12.270099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735248a8-f29e-4db5-aaa3-027a29eedfbf None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:12.270405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735248a8-f29e-4db5-aaa3-027a29eedfbf None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:12.270680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735248a8-f29e-4db5-aaa3-027a29eedfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:12.290708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-735248a8-f29e-4db5-aaa3-027a29eedfbf None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:12.291928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-735248a8-f29e-4db5-aaa3-027a29eedfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:12.367004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 17/33] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:12.367821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735248a8-f29e-4db5-aaa3-027a29eedfbf None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:12.411470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:12.424699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 17/34] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:05:12 2022] POST /identity/v3/projects => generated 301 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:12.428679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb4209-e17d-4573-bfb3-62143aac067f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:12.498528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:12.514185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735248a8-f29e-4db5-aaa3-027a29eedfbf None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:12.557923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09f72a-fbc6-4acb-a8c5-43f6275da103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:12.558959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09f72a-fbc6-4acb-a8c5-43f6275da103 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:12.560896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09f72a-fbc6-4acb-a8c5-43f6275da103 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:12.561456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09f72a-fbc6-4acb-a8c5-43f6275da103 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:12.562438 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09f72a-fbc6-4acb-a8c5-43f6275da103 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:12.564107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09f72a-fbc6-4acb-a8c5-43f6275da103 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:12.607379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb4209-e17d-4573-bfb3-62143aac067f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:12.646220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987769-a7eb-45ae-8308-ec94e5044f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:12.646930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987769-a7eb-45ae-8308-ec94e5044f07 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:12.647211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987769-a7eb-45ae-8308-ec94e5044f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:12.647492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987769-a7eb-45ae-8308-ec94e5044f07 None admin] PATH_INFO: `/v3/users/75b3532d53944d4789f9bd6bd6ab00cf` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:12.648965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987769-a7eb-45ae-8308-ec94e5044f07 None admin] RBAC: Authorizing `identity:get_user(user_id=75b3532d53944d4789f9bd6bd6ab00cf)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:12.650570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987769-a7eb-45ae-8308-ec94e5044f07 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:12.652389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 18/35] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:12 2022] GET /identity/v3/users/75b3532d53944d4789f9bd6bd6ab00cf => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:12.653134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987769-a7eb-45ae-8308-ec94e5044f07 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:12.766518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987769-a7eb-45ae-8308-ec94e5044f07 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:12.781598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:12.802394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864138e-0ea2-4596-a6e8-7ecca1813cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:12.803021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864138e-0ea2-4596-a6e8-7ecca1813cb0 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:12.803305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864138e-0ea2-4596-a6e8-7ecca1813cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:12.803586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864138e-0ea2-4596-a6e8-7ecca1813cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:12.804312 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864138e-0ea2-4596-a6e8-7ecca1813cb0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:12.805703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864138e-0ea2-4596-a6e8-7ecca1813cb0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:12.816784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 18/36] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Aug 4 05:05:12 2022] POST /identity/v3/roles => generated 225 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:12.818262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ec88-ff1d-41b9-a2f5-6b7d7381086a None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:12.818579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ec88-ff1d-41b9-a2f5-6b7d7381086a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:12.818854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ec88-ff1d-41b9-a2f5-6b7d7381086a None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:12.820247 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 19/37] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:12.820788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5ec88-ff1d-41b9-a2f5-6b7d7381086a None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:12.915471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:12.926084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 19/38] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Aug 4 05:05:12 2022] POST /identity/v3/roles => generated 219 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:12.927640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda014-c19a-47c4-b04a-12086b4696dd None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:12.928052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda014-c19a-47c4-b04a-12086b4696dd None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:12.928347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda014-c19a-47c4-b04a-12086b4696dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:12.956083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5ec88-ff1d-41b9-a2f5-6b7d7381086a None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:12.958103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c5cda014-c19a-47c4-b04a-12086b4696dd None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:12.960219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c5cda014-c19a-47c4-b04a-12086b4696dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:13.017323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63aa54-91e2-4548-bd2a-eb7c51f8bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:13.017869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63aa54-91e2-4548-bd2a-eb7c51f8bf9e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:13.018211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63aa54-91e2-4548-bd2a-eb7c51f8bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:13.018461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63aa54-91e2-4548-bd2a-eb7c51f8bf9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:13.020090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63aa54-91e2-4548-bd2a-eb7c51f8bf9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:13.021722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63aa54-91e2-4548-bd2a-eb7c51f8bf9e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:13.023650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 20/39] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:13.024786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a6ee-8879-47c9-abc6-05025249c0d9 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:13.025076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a6ee-8879-47c9-abc6-05025249c0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:13.025364 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a6ee-8879-47c9-abc6-05025249c0d9 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:13.026638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 21/40] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:13.033363 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60a6ee-8879-47c9-abc6-05025249c0d9 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:13.065207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 20/41] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:13.066633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74990686-5e29-40f8-b630-376b7dcd81fb None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:13.066927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74990686-5e29-40f8-b630-376b7dcd81fb None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:13.067205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74990686-5e29-40f8-b630-376b7dcd81fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:13.089171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-74990686-5e29-40f8-b630-376b7dcd81fb None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:13.090462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-74990686-5e29-40f8-b630-376b7dcd81fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:13.162273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60a6ee-8879-47c9-abc6-05025249c0d9 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:13.178332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 21/42] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:13.178332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74990686-5e29-40f8-b630-376b7dcd81fb None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:13.211204 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67062f3-61b8-4ee0-996c-28fae5b23038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:13.212026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67062f3-61b8-4ee0-996c-28fae5b23038 None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:13.212404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67062f3-61b8-4ee0-996c-28fae5b23038 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:13.212893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67062f3-61b8-4ee0-996c-28fae5b23038 None admin] PATH_INFO: `/v3/domains/default/users/75b3532d53944d4789f9bd6bd6ab00cf/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:13.216393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67062f3-61b8-4ee0-996c-28fae5b23038 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=75b3532d53944d4789f9bd6bd6ab00cf, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:13.217467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:13.219485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67062f3-61b8-4ee0-996c-28fae5b23038 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:13.282762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74990686-5e29-40f8-b630-376b7dcd81fb None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:13.316825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924e1a-8717-44b7-8015-a5f1c90c3201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:13.317439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924e1a-8717-44b7-8015-a5f1c90c3201 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:13.317722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924e1a-8717-44b7-8015-a5f1c90c3201 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:13.317998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924e1a-8717-44b7-8015-a5f1c90c3201 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:13.318735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0924e1a-8717-44b7-8015-a5f1c90c3201 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:13.320110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0924e1a-8717-44b7-8015-a5f1c90c3201 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:13.338719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 22/43] 10.222.0.46 () {58 vars in 1361 bytes} [Thu Aug 4 05:05:13 2022] PUT /identity/v3/domains/default/users/75b3532d53944d4789f9bd6bd6ab00cf/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:05:13.339743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67062f3-61b8-4ee0-996c-28fae5b23038 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:13.351177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:13.416261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Aug 4 05:05:13 2022] POST /identity/v3/roles => generated 223 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:13.454317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67062f3-61b8-4ee0-996c-28fae5b23038 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:13.497110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dafadb-f095-48f3-a2f5-4a7ec146964a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:13.497802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dafadb-f095-48f3-a2f5-4a7ec146964a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:13.498081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dafadb-f095-48f3-a2f5-4a7ec146964a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:13.498380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dafadb-f095-48f3-a2f5-4a7ec146964a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:13.499607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dafadb-f095-48f3-a2f5-4a7ec146964a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:13.501080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dafadb-f095-48f3-a2f5-4a7ec146964a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:13.503172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 23/45] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:13.509151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924e1a-8717-44b7-8015-a5f1c90c3201 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:13.619498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:13.626696 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924e1a-8717-44b7-8015-a5f1c90c3201 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:13.663640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41940756-a908-4875-90be-f3f6d9aebcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:13.664266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41940756-a908-4875-90be-f3f6d9aebcf2 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:13.664549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41940756-a908-4875-90be-f3f6d9aebcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:13.664825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41940756-a908-4875-90be-f3f6d9aebcf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:13.665528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41940756-a908-4875-90be-f3f6d9aebcf2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:13.667005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41940756-a908-4875-90be-f3f6d9aebcf2 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:13.765584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:05:13 2022] POST /identity/v3/projects => generated 312 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:15.417202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a15d4-5c38-4ed1-9a6a-c6f9e2f4ba0d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:15.417765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a15d4-5c38-4ed1-9a6a-c6f9e2f4ba0d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:15.417765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a15d4-5c38-4ed1-9a6a-c6f9e2f4ba0d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:15.420253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 24/47] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:15.425844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a18bdb-3c3c-4a33-abdd-a3b00f04431f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:15.426376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a18bdb-3c3c-4a33-abdd-a3b00f04431f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:15.426481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a18bdb-3c3c-4a33-abdd-a3b00f04431f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:15.445172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-35a18bdb-3c3c-4a33-abdd-a3b00f04431f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:15.446380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-35a18bdb-3c3c-4a33-abdd-a3b00f04431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:15.513268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 24/48] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:15.535864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a15d4-5c38-4ed1-9a6a-c6f9e2f4ba0d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:15.614704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:15.638753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a15d4-5c38-4ed1-9a6a-c6f9e2f4ba0d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:15.674823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be073-e6b5-4b72-b6ad-52b8362f4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:15.675388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be073-e6b5-4b72-b6ad-52b8362f4b85 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:15.675673 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be073-e6b5-4b72-b6ad-52b8362f4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:15.675952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be073-e6b5-4b72-b6ad-52b8362f4b85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:15.687043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409be073-e6b5-4b72-b6ad-52b8362f4b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-409be073-e6b5-4b72-b6ad-52b8362f4b85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:15.693564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:15.694432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:15.695154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 25/49] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:15.700777 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a18bdb-3c3c-4a33-abdd-a3b00f04431f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:15.777055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:15.795505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e60ad1-0d75-4142-9498-194fde963265 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:15.795789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e60ad1-0d75-4142-9498-194fde963265 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:15.796064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e60ad1-0d75-4142-9498-194fde963265 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:15.797677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 26/50] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:05:15.801768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a18bdb-3c3c-4a33-abdd-a3b00f04431f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:15.802595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0457-38df-47b6-9ba8-7e4e68a74686 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:15.802887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0457-38df-47b6-9ba8-7e4e68a74686 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:15.803168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0457-38df-47b6-9ba8-7e4e68a74686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:15.822135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-5f1e0457-38df-47b6-9ba8-7e4e68a74686 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:15.823681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5f1e0457-38df-47b6-9ba8-7e4e68a74686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:15.837013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26366836-8330-4a28-bfba-0ee6d899b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:15.837911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26366836-8330-4a28-bfba-0ee6d899b8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:15.838192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26366836-8330-4a28-bfba-0ee6d899b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:15.838497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26366836-8330-4a28-bfba-0ee6d899b8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:15.839458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26366836-8330-4a28-bfba-0ee6d899b8b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:15.840222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26366836-8330-4a28-bfba-0ee6d899b8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:15.842622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26366836-8330-4a28-bfba-0ee6d899b8b7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:15.850903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 25/51] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:15.856368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26366836-8330-4a28-bfba-0ee6d899b8b7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:15.891850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 27/52] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:15.915259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e0457-38df-47b6-9ba8-7e4e68a74686 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:15.957913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26366836-8330-4a28-bfba-0ee6d899b8b7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:15.980079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:15.991407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32cef1-86d1-4eca-852a-1c50d52b4ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:15.992045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32cef1-86d1-4eca-852a-1c50d52b4ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:16.002177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32cef1-86d1-4eca-852a-1c50d52b4ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:16.002177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32cef1-86d1-4eca-852a-1c50d52b4ba4 None admin] PATH_INFO: `/v3/users/75b3532d53944d4789f9bd6bd6ab00cf` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:16.002177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32cef1-86d1-4eca-852a-1c50d52b4ba4 None admin] RBAC: Authorizing `identity:get_user(user_id=75b3532d53944d4789f9bd6bd6ab00cf)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:16.002177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32cef1-86d1-4eca-852a-1c50d52b4ba4 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:16.002177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:15 2022] GET /identity/v3/users/75b3532d53944d4789f9bd6bd6ab00cf => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:16.002576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32cef1-86d1-4eca-852a-1c50d52b4ba4 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:16.012515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:16.014753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e0457-38df-47b6-9ba8-7e4e68a74686 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:16.049300 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9add4a-28d4-434a-840f-f56ff9ecde6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:16.049937 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9add4a-28d4-434a-840f-f56ff9ecde6c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:16.059219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9add4a-28d4-434a-840f-f56ff9ecde6c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:16.059219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9add4a-28d4-434a-840f-f56ff9ecde6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:16.059219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9add4a-28d4-434a-840f-f56ff9ecde6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:16.059219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9add4a-28d4-434a-840f-f56ff9ecde6c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:16.059219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 28/54] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:16.060859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9add4a-28d4-434a-840f-f56ff9ecde6c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:16.104631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32cef1-86d1-4eca-852a-1c50d52b4ba4 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:16.138065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365541-4566-4db4-a5e9-8b88b6105368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:16.138832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365541-4566-4db4-a5e9-8b88b6105368 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:16.139103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365541-4566-4db4-a5e9-8b88b6105368 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:16.139370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365541-4566-4db4-a5e9-8b88b6105368 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:16.140554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a365541-4566-4db4-a5e9-8b88b6105368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:16.141998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a365541-4566-4db4-a5e9-8b88b6105368 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:16.143597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:16.149280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365541-4566-4db4-a5e9-8b88b6105368 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:16.161870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9add4a-28d4-434a-840f-f56ff9ecde6c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:16.197471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9dd9d-4e4d-48bd-a96e-84c28132470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:16.198095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9dd9d-4e4d-48bd-a96e-84c28132470e None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:16.198409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9dd9d-4e4d-48bd-a96e-84c28132470e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:16.198694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9dd9d-4e4d-48bd-a96e-84c28132470e None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:16.199383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9dd9d-4e4d-48bd-a96e-84c28132470e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:16.201201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9dd9d-4e4d-48bd-a96e-84c28132470e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:16.206094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:16.227475 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:16.252073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365541-4566-4db4-a5e9-8b88b6105368 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:16.285879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf92a17-3545-48bf-a743-3f60661a4c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:16.286518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf92a17-3545-48bf-a743-3f60661a4c5b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:16.286805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf92a17-3545-48bf-a743-3f60661a4c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:16.287084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf92a17-3545-48bf-a743-3f60661a4c5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:16.287900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf92a17-3545-48bf-a743-3f60661a4c5b None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.domain.id=default, user.id=75b3532d53944d4789f9bd6bd6ab00cf) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:16.288220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf92a17-3545-48bf-a743-3f60661a4c5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:16.289656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf92a17-3545-48bf-a743-3f60661a4c5b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:16.295339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 28/56] 10.222.0.46 () {56 vars in 1322 bytes} [Thu Aug 4 05:05:16 2022] GET /identity/v3/role_assignments?user.id=75b3532d53944d4789f9bd6bd6ab00cf&scope.domain.id=default&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:16.308460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 29/57] 10.222.0.46 () {60 vars in 1140 bytes} [Thu Aug 4 05:05:16 2022] POST /identity/v3/projects => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:05:18.339467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b40d-da38-4b8f-8d00-f0bedd8567ba None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:18.339973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b40d-da38-4b8f-8d00-f0bedd8567ba None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:18.340059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b40d-da38-4b8f-8d00-f0bedd8567ba None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:18.341459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 29/58] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:18.346715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72cf7-b6ed-4059-ad98-63ccc5f55c29 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:18.347176 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72cf7-b6ed-4059-ad98-63ccc5f55c29 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:18.347301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72cf7-b6ed-4059-ad98-63ccc5f55c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:18.365640 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9da72cf7-b6ed-4059-ad98-63ccc5f55c29 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:18.366848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9da72cf7-b6ed-4059-ad98-63ccc5f55c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:18.431924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 30/59] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:18.456339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b40d-da38-4b8f-8d00-f0bedd8567ba None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:18.558084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b40d-da38-4b8f-8d00-f0bedd8567ba None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:18.590555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c57d4f-9e45-43de-8e44-9703cb0e059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:18.591313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c57d4f-9e45-43de-8e44-9703cb0e059c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:18.591588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c57d4f-9e45-43de-8e44-9703cb0e059c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:18.591861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c57d4f-9e45-43de-8e44-9703cb0e059c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:18.593005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c57d4f-9e45-43de-8e44-9703cb0e059c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:18.594466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c57d4f-9e45-43de-8e44-9703cb0e059c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:18.596155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 30/60] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:18.601687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da72cf7-b6ed-4059-ad98-63ccc5f55c29 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:18.701491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da72cf7-b6ed-4059-ad98-63ccc5f55c29 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:18.718566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:18.736537 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e361c-67e5-4578-b75a-836d896a6e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:18.737156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e361c-67e5-4578-b75a-836d896a6e87 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:18.737467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e361c-67e5-4578-b75a-836d896a6e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:18.737743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e361c-67e5-4578-b75a-836d896a6e87 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:18.738468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e361c-67e5-4578-b75a-836d896a6e87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:18.739910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e361c-67e5-4578-b75a-836d896a6e87 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:18.871427 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 31/61] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:05:18 2022] POST /identity/v3/users => generated 275 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:05:21.993262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9ff2-003c-4dac-884f-46b61a9830a6 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:21.993799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9ff2-003c-4dac-884f-46b61a9830a6 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:21.993799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9ff2-003c-4dac-884f-46b61a9830a6 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:21.995200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 31/62] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:22.001100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dcc7-db80-4db9-bedd-e4a68bd2393d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.001885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dcc7-db80-4db9-bedd-e4a68bd2393d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.002324 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dcc7-db80-4db9-bedd-e4a68bd2393d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.031473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-7301dcc7-db80-4db9-bedd-e4a68bd2393d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:22.032709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7301dcc7-db80-4db9-bedd-e4a68bd2393d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:22.060997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb328-e68f-4497-86d3-b50dd477e9ea None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.061555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb328-e68f-4497-86d3-b50dd477e9ea None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.062002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb328-e68f-4497-86d3-b50dd477e9ea None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.063580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:22.068535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888e094-f133-4e0e-b4c2-fe5dcdf60f1b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.069036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888e094-f133-4e0e-b4c2-fe5dcdf60f1b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.069487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888e094-f133-4e0e-b4c2-fe5dcdf60f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.086684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:22.097669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b888e094-f133-4e0e-b4c2-fe5dcdf60f1b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:22.098885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b888e094-f133-4e0e-b4c2-fe5dcdf60f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:22.169158 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 32/64] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:22.194723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301dcc7-db80-4db9-bedd-e4a68bd2393d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:22.261597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 33/65] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:22.300872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888e094-f133-4e0e-b4c2-fe5dcdf60f1b None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:22.383971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301dcc7-db80-4db9-bedd-e4a68bd2393d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:22.385785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:22.439936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0465e-c90d-4cb6-ae89-f17f51df350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:22.440745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0465e-c90d-4cb6-ae89-f17f51df350a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.441023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0465e-c90d-4cb6-ae89-f17f51df350a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.441290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0465e-c90d-4cb6-ae89-f17f51df350a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.461278 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0465e-c90d-4cb6-ae89-f17f51df350a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-10c0465e-c90d-4cb6-ae89-f17f51df350a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:22.467087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:22.467978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:22.468717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 33/66] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:22.470020 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c7b51-1b1a-458c-95a8-d584b78f5896 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.470552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c7b51-1b1a-458c-95a8-d584b78f5896 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.470997 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c7b51-1b1a-458c-95a8-d584b78f5896 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.472447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 34/67] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:22.477259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c7b51-1b1a-458c-95a8-d584b78f5896 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:22.484661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888e094-f133-4e0e-b4c2-fe5dcdf60f1b None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:22.537555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbf224-6abc-48b2-88e0-ce1a2323ff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:22.538269 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbf224-6abc-48b2-88e0-ce1a2323ff90 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.538647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbf224-6abc-48b2-88e0-ce1a2323ff90 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.538997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbf224-6abc-48b2-88e0-ce1a2323ff90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.543388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:22.556463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbf224-6abc-48b2-88e0-ce1a2323ff90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-61bbf224-6abc-48b2-88e0-ce1a2323ff90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:22.565115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:22.566023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:22.566797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:22.567495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 34/68] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:05:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:05:22.569229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4f333-b616-4554-a695-921d543febba None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.569519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4f333-b616-4554-a695-921d543febba None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.569799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4f333-b616-4554-a695-921d543febba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.587828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b4f4f333-b616-4554-a695-921d543febba None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:22.589020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b4f4f333-b616-4554-a695-921d543febba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:22.600964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c7b51-1b1a-458c-95a8-d584b78f5896 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:22.634870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df5c1c-b408-4dfb-ad49-67da85d3184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:22.635485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5c1c-b408-4dfb-ad49-67da85d3184e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.635759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5c1c-b408-4dfb-ad49-67da85d3184e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.636027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5c1c-b408-4dfb-ad49-67da85d3184e None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.636730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df5c1c-b408-4dfb-ad49-67da85d3184e None admin] RBAC: Adding query filter params (name=member) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:22.637027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df5c1c-b408-4dfb-ad49-67da85d3184e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:22.639126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df5c1c-b408-4dfb-ad49-67da85d3184e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:22.647147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 35/69] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:22.648443 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a99bd3-c8e1-4efb-9f9e-084d4a4df1ee None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.648731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a99bd3-c8e1-4efb-9f9e-084d4a4df1ee None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.649004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a99bd3-c8e1-4efb-9f9e-084d4a4df1ee None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.650201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 36/70] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:22.651289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d212e90-5bee-475c-8955-d71a903d16f6 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.651660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d212e90-5bee-475c-8955-d71a903d16f6 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.651930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d212e90-5bee-475c-8955-d71a903d16f6 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.653473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 37/71] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:22.654399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d212e90-5bee-475c-8955-d71a903d16f6 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:22.660237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 35/72] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:22.664687 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4f333-b616-4554-a695-921d543febba None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:22.682087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:22.761442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d212e90-5bee-475c-8955-d71a903d16f6 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:22.767487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4f333-b616-4554-a695-921d543febba None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:22.792837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:22.796046 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43deaf5-5ece-49ee-9450-fa2659032168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:22.796700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43deaf5-5ece-49ee-9450-fa2659032168 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.796974 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43deaf5-5ece-49ee-9450-fa2659032168 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.797501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43deaf5-5ece-49ee-9450-fa2659032168 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.798213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43deaf5-5ece-49ee-9450-fa2659032168 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:22.798545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43deaf5-5ece-49ee-9450-fa2659032168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:22.799979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43deaf5-5ece-49ee-9450-fa2659032168 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:22.802271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725116c0-23f2-413d-989a-3ed20688eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:22.802942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725116c0-23f2-413d-989a-3ed20688eee6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.803238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725116c0-23f2-413d-989a-3ed20688eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.803505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725116c0-23f2-413d-989a-3ed20688eee6 None admin] PATH_INFO: `/v3/users/e0489743915a4b6fb0142190909fa24c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.811180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 38/73] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:22.811180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cc32c-dbfa-4c0c-9437-70ce2dbff685 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.811180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cc32c-dbfa-4c0c-9437-70ce2dbff685 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.811180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cc32c-dbfa-4c0c-9437-70ce2dbff685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.819491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725116c0-23f2-413d-989a-3ed20688eee6 None admin] RBAC: Authorizing `identity:get_user(user_id=e0489743915a4b6fb0142190909fa24c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:22.820942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725116c0-23f2-413d-989a-3ed20688eee6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:22.822661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 36/74] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:22 2022] GET /identity/v3/users/e0489743915a4b6fb0142190909fa24c => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:22.823893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6d101-09d3-40db-88aa-49a64c8c4fac None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:22.824177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6d101-09d3-40db-88aa-49a64c8c4fac None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:22.824454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6d101-09d3-40db-88aa-49a64c8c4fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:22.831701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-069cc32c-dbfa-4c0c-9437-70ce2dbff685 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:22.832905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-069cc32c-dbfa-4c0c-9437-70ce2dbff685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:22.842183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-22d6d101-09d3-40db-88aa-49a64c8c4fac None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:22.843385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-22d6d101-09d3-40db-88aa-49a64c8c4fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:22.901960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 39/75] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:22.902851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cc32c-dbfa-4c0c-9437-70ce2dbff685 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:22.920041 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 37/76] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:22.920498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:22.921832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6d101-09d3-40db-88aa-49a64c8c4fac None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:23.010497 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cc32c-dbfa-4c0c-9437-70ce2dbff685 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.025169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6d101-09d3-40db-88aa-49a64c8c4fac None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.039742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:23.045670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad482-8fe7-49cc-b87d-147a79ceed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:23.046258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad482-8fe7-49cc-b87d-147a79ceed94 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:23.046579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad482-8fe7-49cc-b87d-147a79ceed94 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:23.046850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad482-8fe7-49cc-b87d-147a79ceed94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:23.057462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ad482-8fe7-49cc-b87d-147a79ceed94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:23.059512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737906e-a02f-42c0-867d-2de5a1d73fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:23.060302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737906e-a02f-42c0-867d-2de5a1d73fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:23.060590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737906e-a02f-42c0-867d-2de5a1d73fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:23.060873 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737906e-a02f-42c0-867d-2de5a1d73fe9 None admin] PATH_INFO: `/v3/users/75b3532d53944d4789f9bd6bd6ab00cf` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:23.062966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737906e-a02f-42c0-867d-2de5a1d73fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=75b3532d53944d4789f9bd6bd6ab00cf)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-638ad482-8fe7-49cc-b87d-147a79ceed94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:23.063056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:23.064089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:23.064849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:23.069837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737906e-a02f-42c0-867d-2de5a1d73fe9 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:23.069919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 40/77] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:05:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:23.069919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad482-8fe7-49cc-b87d-147a79ceed94 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:23.070054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 38/78] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:22 2022] GET /identity/v3/users/75b3532d53944d4789f9bd6bd6ab00cf => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:23.070054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737906e-a02f-42c0-867d-2de5a1d73fe9 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:23.146233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:23.169909 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737906e-a02f-42c0-867d-2de5a1d73fe9 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.172556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad482-8fe7-49cc-b87d-147a79ceed94 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.204453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83962b50-857a-4948-b13f-c5fffc9f1efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:23.205220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83962b50-857a-4948-b13f-c5fffc9f1efd None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:23.205492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83962b50-857a-4948-b13f-c5fffc9f1efd None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:23.205766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83962b50-857a-4948-b13f-c5fffc9f1efd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:23.206507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082bc6c-f5d4-4c77-b663-f6ced711df22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:23.206934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83962b50-857a-4948-b13f-c5fffc9f1efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:23.207120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082bc6c-f5d4-4c77-b663-f6ced711df22 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:23.207403 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082bc6c-f5d4-4c77-b663-f6ced711df22 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:23.207675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082bc6c-f5d4-4c77-b663-f6ced711df22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:23.208385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83962b50-857a-4948-b13f-c5fffc9f1efd None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:23.209973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 39/79] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:23.210759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83962b50-857a-4948-b13f-c5fffc9f1efd None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:23.259903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:23.277655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082bc6c-f5d4-4c77-b663-f6ced711df22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:23.279922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082bc6c-f5d4-4c77-b663-f6ced711df22 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:23.310748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83962b50-857a-4948-b13f-c5fffc9f1efd None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.344073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ce41c-3184-4939-ab96-25a5a9983348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:23.344709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ce41c-3184-4939-ab96-25a5a9983348 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:23.344990 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ce41c-3184-4939-ab96-25a5a9983348 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:23.345269 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ce41c-3184-4939-ab96-25a5a9983348 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:23.354335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:23.355264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ce41c-3184-4939-ab96-25a5a9983348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-7d3ce41c-3184-4939-ab96-25a5a9983348 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:23.361447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:23.362455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 40/80] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:23.379327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ce41c-3184-4939-ab96-25a5a9983348 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:23.379983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 41/81] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:23.379983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082bc6c-f5d4-4c77-b663-f6ced711df22 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:23.469039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ce41c-3184-4939-ab96-25a5a9983348 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.479139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:23.480006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082bc6c-f5d4-4c77-b663-f6ced711df22 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.502893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f5129-feca-449d-913c-c2975adb1b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:23.503534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f5129-feca-449d-913c-c2975adb1b81 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:23.503815 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f5129-feca-449d-913c-c2975adb1b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:23.504112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f5129-feca-449d-913c-c2975adb1b81 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:23.504859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f5129-feca-449d-913c-c2975adb1b81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:23.505162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f5129-feca-449d-913c-c2975adb1b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:23.506574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f5129-feca-449d-913c-c2975adb1b81 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:23.514871 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 41/82] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:05:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:23.515091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2ad88-3a98-4829-bafe-27586c5a4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:23.515681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f5129-feca-449d-913c-c2975adb1b81 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:23.515981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2ad88-3a98-4829-bafe-27586c5a4a12 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:23.516389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2ad88-3a98-4829-bafe-27586c5a4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:23.516670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2ad88-3a98-4829-bafe-27586c5a4a12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:23.568799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:23.591257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2ad88-3a98-4829-bafe-27586c5a4a12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:23.592763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2ad88-3a98-4829-bafe-27586c5a4a12 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:23.617845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f5129-feca-449d-913c-c2975adb1b81 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.654491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d821c-963c-4a44-843f-a8d4b2b60a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:23.655110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d821c-963c-4a44-843f-a8d4b2b60a57 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:23.655395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d821c-963c-4a44-843f-a8d4b2b60a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:23.655674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d821c-963c-4a44-843f-a8d4b2b60a57 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:23.656356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d821c-963c-4a44-843f-a8d4b2b60a57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:23.657798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d821c-963c-4a44-843f-a8d4b2b60a57 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:23.694401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 42/83] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:23.695246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2ad88-3a98-4829-bafe-27586c5a4a12 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:23.768277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:23.789504 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2ad88-3a98-4829-bafe-27586c5a4a12 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.807945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 42/84] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:05:23 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:23.808774 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d821c-963c-4a44-843f-a8d4b2b60a57 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:23.830529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824a8d2-7746-4017-b01c-235b76d1be8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:23.831149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824a8d2-7746-4017-b01c-235b76d1be8c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:23.831393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824a8d2-7746-4017-b01c-235b76d1be8c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:23.831670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824a8d2-7746-4017-b01c-235b76d1be8c None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:23.832408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824a8d2-7746-4017-b01c-235b76d1be8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:23.832711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824a8d2-7746-4017-b01c-235b76d1be8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:23.834170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824a8d2-7746-4017-b01c-235b76d1be8c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:23.843094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:23.844182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 43/85] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:23.845054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824a8d2-7746-4017-b01c-235b76d1be8c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:23.936357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d821c-963c-4a44-843f-a8d4b2b60a57 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.965085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824a8d2-7746-4017-b01c-235b76d1be8c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:23.980260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b26e2-9559-4dbe-9638-23327bc9a5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:23.980914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b26e2-9559-4dbe-9638-23327bc9a5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:23.981218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b26e2-9559-4dbe-9638-23327bc9a5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:23.982021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b26e2-9559-4dbe-9638-23327bc9a5d4 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:23.983246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b26e2-9559-4dbe-9638-23327bc9a5d4 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:23.984830 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b26e2-9559-4dbe-9638-23327bc9a5d4 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:23.986559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 43/86] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:23 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:23.986559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b26e2-9559-4dbe-9638-23327bc9a5d4 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:24.015237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e693b-65a6-4b14-a795-df5d1713ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:24.015878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e693b-65a6-4b14-a795-df5d1713ac22 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:24.016160 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e693b-65a6-4b14-a795-df5d1713ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:24.016438 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e693b-65a6-4b14-a795-df5d1713ac22 None admin] PATH_INFO: `/v3/users/e0489743915a4b6fb0142190909fa24c` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:24.018870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e693b-65a6-4b14-a795-df5d1713ac22 None admin] RBAC: Authorizing `identity:get_user(user_id=e0489743915a4b6fb0142190909fa24c)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:24.020318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e693b-65a6-4b14-a795-df5d1713ac22 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:24.022172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 44/87] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:23 2022] GET /identity/v3/users/e0489743915a4b6fb0142190909fa24c => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:24.023085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e693b-65a6-4b14-a795-df5d1713ac22 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:24.034509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:24.105743 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:24.114966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b26e2-9559-4dbe-9638-23327bc9a5d4 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:24.159860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e693b-65a6-4b14-a795-df5d1713ac22 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:24.167628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7147cc-3cde-4c74-9a5d-23253a0ebd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:24.167628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7147cc-3cde-4c74-9a5d-23253a0ebd49 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:24.167628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7147cc-3cde-4c74-9a5d-23253a0ebd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:24.167628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7147cc-3cde-4c74-9a5d-23253a0ebd49 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:24.173788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7147cc-3cde-4c74-9a5d-23253a0ebd49 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:24.175635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7147cc-3cde-4c74-9a5d-23253a0ebd49 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:24.177837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 44/88] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:23 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:24.179010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7147cc-3cde-4c74-9a5d-23253a0ebd49 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:24.202588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab92067-a79c-41b8-acb3-9b0222a0b8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:24.203269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab92067-a79c-41b8-acb3-9b0222a0b8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:24.203548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab92067-a79c-41b8-acb3-9b0222a0b8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:24.203820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab92067-a79c-41b8-acb3-9b0222a0b8b6 None admin] PATH_INFO: `/v3/users/e0489743915a4b6fb0142190909fa24c` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:24.205194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab92067-a79c-41b8-acb3-9b0222a0b8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=e0489743915a4b6fb0142190909fa24c)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:24.206973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab92067-a79c-41b8-acb3-9b0222a0b8b6 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:24.208667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 45/89] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:24 2022] GET /identity/v3/users/e0489743915a4b6fb0142190909fa24c => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:24.209915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab92067-a79c-41b8-acb3-9b0222a0b8b6 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:24.302274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7147cc-3cde-4c74-9a5d-23253a0ebd49 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:24.313628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:24.348969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab92067-a79c-41b8-acb3-9b0222a0b8b6 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:24.353613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184c88a-3854-42e5-9a99-4870d1777859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:24.354527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184c88a-3854-42e5-9a99-4870d1777859 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:24.355012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184c88a-3854-42e5-9a99-4870d1777859 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:24.355490 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184c88a-3854-42e5-9a99-4870d1777859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:24.356710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184c88a-3854-42e5-9a99-4870d1777859 None admin] RBAC: Adding query filter params (role.id=135a36507984447394cee2c2924414bb, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7, user.id=e0489743915a4b6fb0142190909fa24c) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:24.357234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184c88a-3854-42e5-9a99-4870d1777859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:24.359101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184c88a-3854-42e5-9a99-4870d1777859 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:24.365787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 45/90] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:24 2022] GET /identity/v3/role_assignments?user.id=e0489743915a4b6fb0142190909fa24c&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=135a36507984447394cee2c2924414bb => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:24.367203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184c88a-3854-42e5-9a99-4870d1777859 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:24.391346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72247f-ac3a-4a9e-bdc4-21248a83fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:24.392032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72247f-ac3a-4a9e-bdc4-21248a83fce7 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:24.392314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72247f-ac3a-4a9e-bdc4-21248a83fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:24.392642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72247f-ac3a-4a9e-bdc4-21248a83fce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:24.418749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:24.506709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184c88a-3854-42e5-9a99-4870d1777859 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:24.532444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72247f-ac3a-4a9e-bdc4-21248a83fce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:24.533925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72247f-ac3a-4a9e-bdc4-21248a83fce7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:24.561525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88b24f-fa8a-4e02-9599-978b0aafae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:24.562198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88b24f-fa8a-4e02-9599-978b0aafae44 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:24.562512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88b24f-fa8a-4e02-9599-978b0aafae44 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:24.562789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88b24f-fa8a-4e02-9599-978b0aafae44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:24.563586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88b24f-fa8a-4e02-9599-978b0aafae44 None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7, user.id=75b3532d53944d4789f9bd6bd6ab00cf) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:24.563891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88b24f-fa8a-4e02-9599-978b0aafae44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:24.565334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88b24f-fa8a-4e02-9599-978b0aafae44 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:24.572502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 46/91] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:24 2022] GET /identity/v3/role_assignments?user.id=75b3532d53944d4789f9bd6bd6ab00cf&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:24.573070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88b24f-fa8a-4e02-9599-978b0aafae44 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:24.693380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:24.696923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:24.706490 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88b24f-fa8a-4e02-9599-978b0aafae44 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:24.748259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149e2a5-19af-41f0-a51c-4614e16b482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:24.749126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149e2a5-19af-41f0-a51c-4614e16b482e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:24.749503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149e2a5-19af-41f0-a51c-4614e16b482e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:24.749877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149e2a5-19af-41f0-a51c-4614e16b482e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:24.755635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 46/92] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:24.761674 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72247f-ac3a-4a9e-bdc4-21248a83fce7 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:24.828344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149e2a5-19af-41f0-a51c-4614e16b482e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:24.830012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149e2a5-19af-41f0-a51c-4614e16b482e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:24.880610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72247f-ac3a-4a9e-bdc4-21248a83fce7 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:24.922547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863d8e0-b7b2-4350-abdb-94a64f53bc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:24.923207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863d8e0-b7b2-4350-abdb-94a64f53bc36 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:24.923487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863d8e0-b7b2-4350-abdb-94a64f53bc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:24.923850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863d8e0-b7b2-4350-abdb-94a64f53bc36 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:24.925059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863d8e0-b7b2-4350-abdb-94a64f53bc36 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:24.926536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863d8e0-b7b2-4350-abdb-94a64f53bc36 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:24.928905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 47/93] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:24 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:24.935699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863d8e0-b7b2-4350-abdb-94a64f53bc36 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:24.951982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:24.963347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 47/94] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:24.970244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149e2a5-19af-41f0-a51c-4614e16b482e None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:24.998716 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:25.057350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863d8e0-b7b2-4350-abdb-94a64f53bc36 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:25.115011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fcbfb-e48f-4692-9fbd-c6a829f5ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:25.116042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fcbfb-e48f-4692-9fbd-c6a829f5ac70 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:25.116546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fcbfb-e48f-4692-9fbd-c6a829f5ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:25.117033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fcbfb-e48f-4692-9fbd-c6a829f5ac70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:25.118031 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fcbfb-e48f-4692-9fbd-c6a829f5ac70 None admin] RBAC: Adding query filter params (role.id=ac5a79a4ca8d49298d455da9928e5a4f, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7, user.id=e0489743915a4b6fb0142190909fa24c) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:25.118588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fcbfb-e48f-4692-9fbd-c6a829f5ac70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:25.120299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fcbfb-e48f-4692-9fbd-c6a829f5ac70 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:25.134449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 48/95] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:24 2022] GET /identity/v3/role_assignments?user.id=e0489743915a4b6fb0142190909fa24c&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=ac5a79a4ca8d49298d455da9928e5a4f => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:25.194551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149e2a5-19af-41f0-a51c-4614e16b482e None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:25.249272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed509f-8da8-4e25-b9df-97dee59464c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:25.249835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed509f-8da8-4e25-b9df-97dee59464c2 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:25.250115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed509f-8da8-4e25-b9df-97dee59464c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:25.250411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed509f-8da8-4e25-b9df-97dee59464c2 None admin] PATH_INFO: `/v3/projects/7dadd13d4c504c35aae22cc8658eafdd` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:25.255148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed509f-8da8-4e25-b9df-97dee59464c2 None admin] RBAC: Authorizing `identity:get_project(project_id=7dadd13d4c504c35aae22cc8658eafdd)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:25.256641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed509f-8da8-4e25-b9df-97dee59464c2 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:25.258411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 48/96] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:24 2022] GET /identity/v3/projects/7dadd13d4c504c35aae22cc8658eafdd => generated 312 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:25.264856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fcbfb-e48f-4692-9fbd-c6a829f5ac70 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:25.414490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fcbfb-e48f-4692-9fbd-c6a829f5ac70 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:25.425523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:25.460200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a87e49-b24c-43e8-9fc4-8cb92035b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:25.460821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a87e49-b24c-43e8-9fc4-8cb92035b3bf None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:25.461099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a87e49-b24c-43e8-9fc4-8cb92035b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:25.461370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a87e49-b24c-43e8-9fc4-8cb92035b3bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:25.462163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a87e49-b24c-43e8-9fc4-8cb92035b3bf None admin] RBAC: Adding query filter params (role.id=135a36507984447394cee2c2924414bb, scope.project.id=7dadd13d4c504c35aae22cc8658eafdd, user.id=e0489743915a4b6fb0142190909fa24c) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:25.462543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a87e49-b24c-43e8-9fc4-8cb92035b3bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:25.464035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a87e49-b24c-43e8-9fc4-8cb92035b3bf None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:25.475004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 49/97] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:25 2022] GET /identity/v3/role_assignments?user.id=e0489743915a4b6fb0142190909fa24c&scope.project.id=7dadd13d4c504c35aae22cc8658eafdd&role.id=135a36507984447394cee2c2924414bb => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:26.626748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36155c-8819-4eff-aede-81cc1c2f3cfd None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:26.627280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36155c-8819-4eff-aede-81cc1c2f3cfd None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:26.627280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36155c-8819-4eff-aede-81cc1c2f3cfd None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:26.628637 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 49/98] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:26.634051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284583d-60ae-4823-9598-6eaecf730c5c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:26.634536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284583d-60ae-4823-9598-6eaecf730c5c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:26.634616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284583d-60ae-4823-9598-6eaecf730c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:26.659334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0284583d-60ae-4823-9598-6eaecf730c5c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:26.660571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0284583d-60ae-4823-9598-6eaecf730c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:26.753818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 50/99] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:26.799965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36155c-8819-4eff-aede-81cc1c2f3cfd None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:26.879530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:26.936165 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36155c-8819-4eff-aede-81cc1c2f3cfd None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:26.978282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7cf4-45c8-4687-80ed-9e0fb85db7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:26.978950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7cf4-45c8-4687-80ed-9e0fb85db7ca None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:26.979230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7cf4-45c8-4687-80ed-9e0fb85db7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:26.979539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7cf4-45c8-4687-80ed-9e0fb85db7ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:26.983000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7cf4-45c8-4687-80ed-9e0fb85db7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:26.984455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7cf4-45c8-4687-80ed-9e0fb85db7ca None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:26.986409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 50/100] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:26.992189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284583d-60ae-4823-9598-6eaecf730c5c None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:27.107252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:27.113273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284583d-60ae-4823-9598-6eaecf730c5c None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:27.159752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c9b10-059f-45dd-ac9f-c6086a720059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:27.159752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9b10-059f-45dd-ac9f-c6086a720059 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:27.159752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9b10-059f-45dd-ac9f-c6086a720059 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:27.159752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9b10-059f-45dd-ac9f-c6086a720059 None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:27.160122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c9b10-059f-45dd-ac9f-c6086a720059 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:27.161274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c9b10-059f-45dd-ac9f-c6086a720059 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:27.321920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 51/101] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:05:26 2022] POST /identity/v3/projects => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:27.482583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6821ead-6530-4391-a390-193acedc4a43 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:27.482583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6821ead-6530-4391-a390-193acedc4a43 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:27.482841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6821ead-6530-4391-a390-193acedc4a43 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:27.484209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 51/102] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:27.490027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b80f5f-ddae-4651-aac0-a27b438dcfc4 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:27.490335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b80f5f-ddae-4651-aac0-a27b438dcfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:27.490625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b80f5f-ddae-4651-aac0-a27b438dcfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:27.515662 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-01b80f5f-ddae-4651-aac0-a27b438dcfc4 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:27.516925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-01b80f5f-ddae-4651-aac0-a27b438dcfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:27.524791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262367a1-8fe2-46ac-be8c-f89a40ef8d4f None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:27.525102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262367a1-8fe2-46ac-be8c-f89a40ef8d4f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:27.525376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262367a1-8fe2-46ac-be8c-f89a40ef8d4f None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:27.526894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 52/103] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:27.535346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ea859-b407-4f26-97ee-33534f80d731 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:27.535940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ea859-b407-4f26-97ee-33534f80d731 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:27.536404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ea859-b407-4f26-97ee-33534f80d731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:27.570085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8c2ea859-b407-4f26-97ee-33534f80d731 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:27.573494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8c2ea859-b407-4f26-97ee-33534f80d731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:27.669121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 52/104] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:27.698264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 53/105] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:27.713345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b80f5f-ddae-4651-aac0-a27b438dcfc4 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:27.739760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ea859-b407-4f26-97ee-33534f80d731 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:27.814449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:27.833841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:27.857487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b80f5f-ddae-4651-aac0-a27b438dcfc4 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:27.864807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ea859-b407-4f26-97ee-33534f80d731 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:27.900377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93cd7b-1691-414a-b091-f2bbbe77c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:27.901030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93cd7b-1691-414a-b091-f2bbbe77c54f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:27.901310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93cd7b-1691-414a-b091-f2bbbe77c54f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:27.901586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93cd7b-1691-414a-b091-f2bbbe77c54f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:27.906574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c4122-c058-44b5-a5cf-a08dc6afb925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:27.907781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c4122-c058-44b5-a5cf-a08dc6afb925 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:27.908288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c4122-c058-44b5-a5cf-a08dc6afb925 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:27.908795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c4122-c058-44b5-a5cf-a08dc6afb925 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:27.914902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93cd7b-1691-414a-b091-f2bbbe77c54f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-ff93cd7b-1691-414a-b091-f2bbbe77c54f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:27.922586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:27.923751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:27.924724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:27.927682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 53/106] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:27.929367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607b7c2-9efe-4d2a-b09d-6b00bdeea07e None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:27.929808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607b7c2-9efe-4d2a-b09d-6b00bdeea07e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:27.930010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c4122-c058-44b5-a5cf-a08dc6afb925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:27.930537 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607b7c2-9efe-4d2a-b09d-6b00bdeea07e None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:27.932620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 54/107] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-af7c4122-c058-44b5-a5cf-a08dc6afb925 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:27.940545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:27.941454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:27.942207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 54/108] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:05:27.943102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607b7c2-9efe-4d2a-b09d-6b00bdeea07e None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:27.945842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127b1c4-8c28-4ab0-8337-cd0c90877468 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:27.945956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127b1c4-8c28-4ab0-8337-cd0c90877468 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:27.947466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127b1c4-8c28-4ab0-8337-cd0c90877468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:27.967981 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-f127b1c4-8c28-4ab0-8337-cd0c90877468 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:27.969532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f127b1c4-8c28-4ab0-8337-cd0c90877468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:28.041974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 55/109] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:28.043239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127b1c4-8c28-4ab0-8337-cd0c90877468 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:28.063422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607b7c2-9efe-4d2a-b09d-6b00bdeea07e None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:28.112937 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3469535-b6c1-4687-8c4b-4e8b8b9f1d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:28.115213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3469535-b6c1-4687-8c4b-4e8b8b9f1d04 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.117225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3469535-b6c1-4687-8c4b-4e8b8b9f1d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.117736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3469535-b6c1-4687-8c4b-4e8b8b9f1d04 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.118702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3469535-b6c1-4687-8c4b-4e8b8b9f1d04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:28.120219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3469535-b6c1-4687-8c4b-4e8b8b9f1d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:28.121863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3469535-b6c1-4687-8c4b-4e8b8b9f1d04 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:28.127060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:28.142384 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 55/110] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:28.146710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3469535-b6c1-4687-8c4b-4e8b8b9f1d04 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:28.174731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:28.205225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127b1c4-8c28-4ab0-8337-cd0c90877468 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:28.242302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bfd17-22f0-44ff-b652-d4b93e125912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:28.243480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bfd17-22f0-44ff-b652-d4b93e125912 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.244032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bfd17-22f0-44ff-b652-d4b93e125912 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.244519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bfd17-22f0-44ff-b652-d4b93e125912 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.245458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bfd17-22f0-44ff-b652-d4b93e125912 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:28.245965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bfd17-22f0-44ff-b652-d4b93e125912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:28.248391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bfd17-22f0-44ff-b652-d4b93e125912 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:28.261084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 56/111] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:28.261084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bfd17-22f0-44ff-b652-d4b93e125912 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:28.304070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3469535-b6c1-4687-8c4b-4e8b8b9f1d04 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:28.342916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7121c-0af6-46d9-a7df-92fa821379df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:28.343817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7121c-0af6-46d9-a7df-92fa821379df None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.344275 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7121c-0af6-46d9-a7df-92fa821379df None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.344550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7121c-0af6-46d9-a7df-92fa821379df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.355569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7121c-0af6-46d9-a7df-92fa821379df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-e4d7121c-0af6-46d9-a7df-92fa821379df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:28.361849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:28.362926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:28.363858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:28.365775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 56/112] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:05:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:28.366975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff5e0-b37c-4990-974c-76db06603bc8 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.367258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff5e0-b37c-4990-974c-76db06603bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.367529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff5e0-b37c-4990-974c-76db06603bc8 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.368774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 57/113] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:28.374035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff5e0-b37c-4990-974c-76db06603bc8 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:28.385419 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bfd17-22f0-44ff-b652-d4b93e125912 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:28.398174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:28.427502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616e93d-cb95-4701-b925-d11d8c1510d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:28.428173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616e93d-cb95-4701-b925-d11d8c1510d9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.428452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616e93d-cb95-4701-b925-d11d8c1510d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.428726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616e93d-cb95-4701-b925-d11d8c1510d9 None admin] PATH_INFO: `/v3/users/e0489743915a4b6fb0142190909fa24c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.429910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616e93d-cb95-4701-b925-d11d8c1510d9 None admin] RBAC: Authorizing `identity:get_user(user_id=e0489743915a4b6fb0142190909fa24c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:28.431517 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616e93d-cb95-4701-b925-d11d8c1510d9 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:28.433115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 57/114] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:28 2022] GET /identity/v3/users/e0489743915a4b6fb0142190909fa24c => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:28.434227 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182509e-84f0-4777-9fb1-be4bd032c7b4 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.434554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182509e-84f0-4777-9fb1-be4bd032c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.434828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182509e-84f0-4777-9fb1-be4bd032c7b4 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.436024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 58/115] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:28.440242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182509e-84f0-4777-9fb1-be4bd032c7b4 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:28.453086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:28.495482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff5e0-b37c-4990-974c-76db06603bc8 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:28.537554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50d35-6dd0-4864-90f5-f0124038b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:28.538212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50d35-6dd0-4864-90f5-f0124038b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.538513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50d35-6dd0-4864-90f5-f0124038b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.538791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50d35-6dd0-4864-90f5-f0124038b9c8 None admin] PATH_INFO: `/v3/users/f05e7fd80c5e4d9a91d436aef7c641b1` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.553617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182509e-84f0-4777-9fb1-be4bd032c7b4 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:28.557386 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e50d35-6dd0-4864-90f5-f0124038b9c8 None admin] RBAC: Authorizing `identity:get_user(user_id=f05e7fd80c5e4d9a91d436aef7c641b1)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:28.558876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e50d35-6dd0-4864-90f5-f0124038b9c8 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:28.560695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 58/116] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:28 2022] GET /identity/v3/users/f05e7fd80c5e4d9a91d436aef7c641b1 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:28.561875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189dedf-0f98-4b25-b064-b171f370ab19 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.562155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189dedf-0f98-4b25-b064-b171f370ab19 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.562449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189dedf-0f98-4b25-b064-b171f370ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.582006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-2189dedf-0f98-4b25-b064-b171f370ab19 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:28.583225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2189dedf-0f98-4b25-b064-b171f370ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:28.598219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3c244-874f-4640-9c88-9a20e80d542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:28.598918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3c244-874f-4640-9c88-9a20e80d542a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.599165 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3c244-874f-4640-9c88-9a20e80d542a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.599442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3c244-874f-4640-9c88-9a20e80d542a None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.600155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3c244-874f-4640-9c88-9a20e80d542a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:28.600496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3c244-874f-4640-9c88-9a20e80d542a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:28.601826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3c244-874f-4640-9c88-9a20e80d542a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:28.611695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 59/117] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:28.612293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3c244-874f-4640-9c88-9a20e80d542a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:28.662565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:28.670863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 59/118] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:28.670863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9516-5637-458a-8067-573a07eaf757 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.670863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9516-5637-458a-8067-573a07eaf757 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.670863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9516-5637-458a-8067-573a07eaf757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.692779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b10f9516-5637-458a-8067-573a07eaf757 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:28.693956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b10f9516-5637-458a-8067-573a07eaf757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:28.745578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3c244-874f-4640-9c88-9a20e80d542a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:28.781833 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:28.801042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b537a8e-0c93-46da-947b-d1ccf05e82cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:28.801681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b537a8e-0c93-46da-947b-d1ccf05e82cb None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.801960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b537a8e-0c93-46da-947b-d1ccf05e82cb None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.802232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b537a8e-0c93-46da-947b-d1ccf05e82cb None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.810541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 60/119] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:28.810541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9516-5637-458a-8067-573a07eaf757 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:28.812381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b537a8e-0c93-46da-947b-d1ccf05e82cb None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:28.814881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b537a8e-0c93-46da-947b-d1ccf05e82cb None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:28.818448 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 60/120] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:28 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:28.819250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b537a8e-0c93-46da-947b-d1ccf05e82cb None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:28.913195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9516-5637-458a-8067-573a07eaf757 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:28.931057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b537a8e-0c93-46da-947b-d1ccf05e82cb None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:28.941597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:28.948952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca11cc8-bfc3-46e0-8d72-f2c0cbd79f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:28.949573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca11cc8-bfc3-46e0-8d72-f2c0cbd79f8e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.949848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca11cc8-bfc3-46e0-8d72-f2c0cbd79f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.950852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca11cc8-bfc3-46e0-8d72-f2c0cbd79f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.972623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761381-2bb9-44d7-a56d-458d18f703a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:28.973360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761381-2bb9-44d7-a56d-458d18f703a1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:28.973649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761381-2bb9-44d7-a56d-458d18f703a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:28.973928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761381-2bb9-44d7-a56d-458d18f703a1 None admin] PATH_INFO: `/v3/users/75b3532d53944d4789f9bd6bd6ab00cf` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:28.975179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81761381-2bb9-44d7-a56d-458d18f703a1 None admin] RBAC: Authorizing `identity:get_user(user_id=75b3532d53944d4789f9bd6bd6ab00cf)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:28.976638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81761381-2bb9-44d7-a56d-458d18f703a1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:28.978563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 61/121] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:28 2022] GET /identity/v3/users/75b3532d53944d4789f9bd6bd6ab00cf => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:28.979139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761381-2bb9-44d7-a56d-458d18f703a1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:29.009940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:29.032978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca11cc8-bfc3-46e0-8d72-f2c0cbd79f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:29.034755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca11cc8-bfc3-46e0-8d72-f2c0cbd79f8e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:29.090073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761381-2bb9-44d7-a56d-458d18f703a1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:29.127784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50589bd-3993-4e0f-bbae-6506ddfe0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:29.128555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50589bd-3993-4e0f-bbae-6506ddfe0c7c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:29.128842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50589bd-3993-4e0f-bbae-6506ddfe0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:29.129259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50589bd-3993-4e0f-bbae-6506ddfe0c7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:29.140556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 61/122] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:29.140556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca11cc8-bfc3-46e0-8d72-f2c0cbd79f8e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:29.145290 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50589bd-3993-4e0f-bbae-6506ddfe0c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-b50589bd-3993-4e0f-bbae-6506ddfe0c7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:29.151541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:29.152480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:29.153810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 62/123] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:05:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:29.154664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50589bd-3993-4e0f-bbae-6506ddfe0c7c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:29.203066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:29.239597 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:29.258424 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca11cc8-bfc3-46e0-8d72-f2c0cbd79f8e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:29.274292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50589bd-3993-4e0f-bbae-6506ddfe0c7c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:29.298285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6daccb-dec7-4074-ac8b-ca41ca6debbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:29.299258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6daccb-dec7-4074-ac8b-ca41ca6debbe None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:29.299546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6daccb-dec7-4074-ac8b-ca41ca6debbe None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:29.299995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6daccb-dec7-4074-ac8b-ca41ca6debbe None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/users/e0489743915a4b6fb0142190909fa24c/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:29.302349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6daccb-dec7-4074-ac8b-ca41ca6debbe None admin] RBAC: Authorizing `identity:create_grant(project_id=c79dd8e7e16b41ea974aa6b292b8aec7, user_id=e0489743915a4b6fb0142190909fa24c, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:29.303804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6daccb-dec7-4074-ac8b-ca41ca6debbe None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:29.311743 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7002f-31b3-4566-8ed6-e846a9771915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:29.312378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7002f-31b3-4566-8ed6-e846a9771915 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:29.312660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7002f-31b3-4566-8ed6-e846a9771915 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:29.312938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7002f-31b3-4566-8ed6-e846a9771915 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:29.322957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7002f-31b3-4566-8ed6-e846a9771915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-1da7002f-31b3-4566-8ed6-e846a9771915 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:29.328048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:29.328904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:29.329639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 63/124] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:29.330261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7002f-31b3-4566-8ed6-e846a9771915 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:29.396456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 62/125] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:05:29 2022] PUT /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/users/e0489743915a4b6fb0142190909fa24c/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:05:29.407334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6daccb-dec7-4074-ac8b-ca41ca6debbe None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:29.435930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:29.443136 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7002f-31b3-4566-8ed6-e846a9771915 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:29.486190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bdac8-20d8-4c76-88fb-637320175405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:29.486926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bdac8-20d8-4c76-88fb-637320175405 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:29.487307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bdac8-20d8-4c76-88fb-637320175405 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:29.487466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bdac8-20d8-4c76-88fb-637320175405 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:29.489152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bdac8-20d8-4c76-88fb-637320175405 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:29.490229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bdac8-20d8-4c76-88fb-637320175405 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:29.493013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 64/126] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:29 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:29.493911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bdac8-20d8-4c76-88fb-637320175405 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:29.573800 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6daccb-dec7-4074-ac8b-ca41ca6debbe None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:29.619629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990518f-4e09-4b45-8d25-855e096033af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:29.620318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990518f-4e09-4b45-8d25-855e096033af None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:29.620604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990518f-4e09-4b45-8d25-855e096033af None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:29.620872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990518f-4e09-4b45-8d25-855e096033af None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:29.622080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990518f-4e09-4b45-8d25-855e096033af None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:29.623589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990518f-4e09-4b45-8d25-855e096033af None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:29.625461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 63/127] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:29 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:29.626057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990518f-4e09-4b45-8d25-855e096033af None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:29.629355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bdac8-20d8-4c76-88fb-637320175405 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:29.644163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:29.680790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e85fb9-59bd-4fd7-bda8-056b177840c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:29.681330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e85fb9-59bd-4fd7-bda8-056b177840c3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:29.681612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e85fb9-59bd-4fd7-bda8-056b177840c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:29.681905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e85fb9-59bd-4fd7-bda8-056b177840c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:29.682643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e85fb9-59bd-4fd7-bda8-056b177840c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:29.682973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e85fb9-59bd-4fd7-bda8-056b177840c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:29.684399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e85fb9-59bd-4fd7-bda8-056b177840c3 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:29.693548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 65/128] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:05:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:29.694323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e85fb9-59bd-4fd7-bda8-056b177840c3 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:29.732797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:29.755398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990518f-4e09-4b45-8d25-855e096033af None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:29.792727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c3c25-edc9-4551-a365-2eef04fa0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:29.793938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3c25-edc9-4551-a365-2eef04fa0b14 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:29.794170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3c25-edc9-4551-a365-2eef04fa0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:29.794582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3c25-edc9-4551-a365-2eef04fa0b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:29.795446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c3c25-edc9-4551-a365-2eef04fa0b14 None admin] RBAC: Adding query filter params (name=member) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:29.795852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c3c25-edc9-4551-a365-2eef04fa0b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:29.797588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c3c25-edc9-4551-a365-2eef04fa0b14 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:29.806971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 64/129] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:29.812558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c3c25-edc9-4551-a365-2eef04fa0b14 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:29.832056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e85fb9-59bd-4fd7-bda8-056b177840c3 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:29.880997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0e3be-c592-487a-9b43-801d8fe5743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:29.881930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0e3be-c592-487a-9b43-801d8fe5743d None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:29.882375 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0e3be-c592-487a-9b43-801d8fe5743d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:29.882795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0e3be-c592-487a-9b43-801d8fe5743d None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/users/75b3532d53944d4789f9bd6bd6ab00cf/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:29.885556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0e3be-c592-487a-9b43-801d8fe5743d None admin] RBAC: Authorizing `identity:create_grant(project_id=c79dd8e7e16b41ea974aa6b292b8aec7, user_id=75b3532d53944d4789f9bd6bd6ab00cf, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:29.888804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0e3be-c592-487a-9b43-801d8fe5743d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:29.889147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:29.922955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c3c25-edc9-4551-a365-2eef04fa0b14 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:29.957771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b68500-436b-4cc1-a514-1efcea4b2686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:29.958290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b68500-436b-4cc1-a514-1efcea4b2686 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:29.958598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b68500-436b-4cc1-a514-1efcea4b2686 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:29.958870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b68500-436b-4cc1-a514-1efcea4b2686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:29.959660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b68500-436b-4cc1-a514-1efcea4b2686 None admin] RBAC: Adding query filter params (role.id=99363062b2b644ee970fba81eb1e5f45, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7, user.id=f05e7fd80c5e4d9a91d436aef7c641b1) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:29.959965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b68500-436b-4cc1-a514-1efcea4b2686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:29.961427 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b68500-436b-4cc1-a514-1efcea4b2686 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:29.967467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 65/130] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:29 2022] GET /identity/v3/role_assignments?user.id=f05e7fd80c5e4d9a91d436aef7c641b1&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=99363062b2b644ee970fba81eb1e5f45 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:29.968486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b68500-436b-4cc1-a514-1efcea4b2686 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:29.992959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 66/131] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:05:29 2022] PUT /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/users/75b3532d53944d4789f9bd6bd6ab00cf/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:05:29.994298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0e3be-c592-487a-9b43-801d8fe5743d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:30.103258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:30.134994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0e3be-c592-487a-9b43-801d8fe5743d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:30.158036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b68500-436b-4cc1-a514-1efcea4b2686 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:30.196272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596bd5-1d91-4942-b609-0de0920669b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:30.196944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596bd5-1d91-4942-b609-0de0920669b6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:30.197231 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596bd5-1d91-4942-b609-0de0920669b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:30.197515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596bd5-1d91-4942-b609-0de0920669b6 None admin] PATH_INFO: `/v3/users/e0489743915a4b6fb0142190909fa24c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:30.200395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596bd5-1d91-4942-b609-0de0920669b6 None admin] RBAC: Authorizing `identity:get_user(user_id=e0489743915a4b6fb0142190909fa24c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:30.203111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596bd5-1d91-4942-b609-0de0920669b6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:30.204880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 67/132] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:29 2022] GET /identity/v3/users/e0489743915a4b6fb0142190909fa24c => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:30.209608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b48979-6b0f-45a5-a901-a38159b29f4b None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:30.211288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b48979-6b0f-45a5-a901-a38159b29f4b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:30.211606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b48979-6b0f-45a5-a901-a38159b29f4b None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:30.213197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 68/133] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:30.216337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b48979-6b0f-45a5-a901-a38159b29f4b None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:30.237591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4eb41-b011-4bf8-a800-065ebeca6f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:30.238252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4eb41-b011-4bf8-a800-065ebeca6f1f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:30.238602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4eb41-b011-4bf8-a800-065ebeca6f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:30.238883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4eb41-b011-4bf8-a800-065ebeca6f1f None admin] PATH_INFO: `/v3/users/e0489743915a4b6fb0142190909fa24c` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:30.240167 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4eb41-b011-4bf8-a800-065ebeca6f1f None admin] RBAC: Authorizing `identity:get_user(user_id=e0489743915a4b6fb0142190909fa24c)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:30.241702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4eb41-b011-4bf8-a800-065ebeca6f1f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:30.243448 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 66/134] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:29 2022] GET /identity/v3/users/e0489743915a4b6fb0142190909fa24c => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:30.244777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bde16a-e4ad-4e3c-bee1-5cbd399d2532 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:30.245125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bde16a-e4ad-4e3c-bee1-5cbd399d2532 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:30.245469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bde16a-e4ad-4e3c-bee1-5cbd399d2532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:30.254863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:30.268139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c3bde16a-e4ad-4e3c-bee1-5cbd399d2532 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:30.269580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c3bde16a-e4ad-4e3c-bee1-5cbd399d2532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:30.351869 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b48979-6b0f-45a5-a901-a38159b29f4b None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:30.356533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 67/135] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:30.357994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bde16a-e4ad-4e3c-bee1-5cbd399d2532 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:30.393711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce38370-1087-4a3d-9080-66b36a5cfad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:30.394562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce38370-1087-4a3d-9080-66b36a5cfad3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:30.394941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce38370-1087-4a3d-9080-66b36a5cfad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:30.395316 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce38370-1087-4a3d-9080-66b36a5cfad3 None admin] PATH_INFO: `/v3/projects/7dadd13d4c504c35aae22cc8658eafdd` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:30.396632 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce38370-1087-4a3d-9080-66b36a5cfad3 None admin] RBAC: Authorizing `identity:get_project(project_id=7dadd13d4c504c35aae22cc8658eafdd)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:30.398237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce38370-1087-4a3d-9080-66b36a5cfad3 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:30.400309 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 69/136] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:30 2022] GET /identity/v3/projects/7dadd13d4c504c35aae22cc8658eafdd => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:30.406537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce38370-1087-4a3d-9080-66b36a5cfad3 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:30.468619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:30.517929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bde16a-e4ad-4e3c-bee1-5cbd399d2532 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:30.559201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a569-588d-47c8-861c-be12a8b186cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:30.560124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a569-588d-47c8-861c-be12a8b186cb None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:30.560552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a569-588d-47c8-861c-be12a8b186cb None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:30.560995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a569-588d-47c8-861c-be12a8b186cb None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:30.562370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5a569-588d-47c8-861c-be12a8b186cb None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:30.564307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5a569-588d-47c8-861c-be12a8b186cb None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:30.566854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 68/137] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:30 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:30.567839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a569-588d-47c8-861c-be12a8b186cb None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:30.570930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:30.695265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a569-588d-47c8-861c-be12a8b186cb None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:30.696518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce38370-1087-4a3d-9080-66b36a5cfad3 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:30.735834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaedafa-62c9-4f9c-a0e2-1bd67f0b245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:30.736402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaedafa-62c9-4f9c-a0e2-1bd67f0b245a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:30.736685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaedafa-62c9-4f9c-a0e2-1bd67f0b245a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:30.736964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaedafa-62c9-4f9c-a0e2-1bd67f0b245a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:30.738175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaedafa-62c9-4f9c-a0e2-1bd67f0b245a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:30.739835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaedafa-62c9-4f9c-a0e2-1bd67f0b245a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:30.741760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 69/138] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:30.742530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaedafa-62c9-4f9c-a0e2-1bd67f0b245a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:30.780519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f49a-63c3-48fe-9b7b-82387e0d82d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:30.781469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f49a-63c3-48fe-9b7b-82387e0d82d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:30.781899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f49a-63c3-48fe-9b7b-82387e0d82d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:30.782339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f49a-63c3-48fe-9b7b-82387e0d82d5 None admin] PATH_INFO: `/v3/projects/7dadd13d4c504c35aae22cc8658eafdd/users/e0489743915a4b6fb0142190909fa24c/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:30.784760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3f49a-63c3-48fe-9b7b-82387e0d82d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dadd13d4c504c35aae22cc8658eafdd, user_id=e0489743915a4b6fb0142190909fa24c, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:30.786403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3f49a-63c3-48fe-9b7b-82387e0d82d5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:30.852096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:30.879818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 70/139] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:05:30 2022] PUT /identity/v3/projects/7dadd13d4c504c35aae22cc8658eafdd/users/e0489743915a4b6fb0142190909fa24c/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:05:30.881482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f49a-63c3-48fe-9b7b-82387e0d82d5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:30.909867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaedafa-62c9-4f9c-a0e2-1bd67f0b245a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:30.984707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f51345-418d-455b-98bd-835ed88c5bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:30.986050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f51345-418d-455b-98bd-835ed88c5bbe None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:30.987532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f51345-418d-455b-98bd-835ed88c5bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:30.990867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f51345-418d-455b-98bd-835ed88c5bbe None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/users/e0489743915a4b6fb0142190909fa24c/roles/ac5a79a4ca8d49298d455da9928e5a4f` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:30.993835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f51345-418d-455b-98bd-835ed88c5bbe None admin] RBAC: Authorizing `identity:create_grant(project_id=c79dd8e7e16b41ea974aa6b292b8aec7, user_id=e0489743915a4b6fb0142190909fa24c, role_id=ac5a79a4ca8d49298d455da9928e5a4f)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:30.997601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f51345-418d-455b-98bd-835ed88c5bbe None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:31.035389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:31.056751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f49a-63c3-48fe-9b7b-82387e0d82d5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:31.079091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 70/140] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:05:30 2022] PUT /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/users/e0489743915a4b6fb0142190909fa24c/roles/ac5a79a4ca8d49298d455da9928e5a4f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:05:31.106976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e369080-485c-4dc1-abf9-7cd8c37ea821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:31.108000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e369080-485c-4dc1-abf9-7cd8c37ea821 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:31.108500 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e369080-485c-4dc1-abf9-7cd8c37ea821 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:31.108980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e369080-485c-4dc1-abf9-7cd8c37ea821 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:31.109997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e369080-485c-4dc1-abf9-7cd8c37ea821 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:31.111879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e369080-485c-4dc1-abf9-7cd8c37ea821 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:31.191653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 71/141] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:05:30 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:32.026980 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059f896-8fa7-4d9d-9acc-914819c22122 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:32.028028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059f896-8fa7-4d9d-9acc-914819c22122 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:32.029065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059f896-8fa7-4d9d-9acc-914819c22122 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:32.030774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 71/142] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:32.036689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7de9fb-348b-4567-ac94-37f1f48fb15c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:32.037538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7de9fb-348b-4567-ac94-37f1f48fb15c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:32.038034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7de9fb-348b-4567-ac94-37f1f48fb15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:32.059274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-fe7de9fb-348b-4567-ac94-37f1f48fb15c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:32.060864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-fe7de9fb-348b-4567-ac94-37f1f48fb15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:32.139205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 72/143] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:32.179536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059f896-8fa7-4d9d-9acc-914819c22122 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:32.309256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059f896-8fa7-4d9d-9acc-914819c22122 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:32.346389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:32.351106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b4f99-6d49-4c58-8b1c-333670f1a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:32.351758 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b4f99-6d49-4c58-8b1c-333670f1a185 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:32.352039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b4f99-6d49-4c58-8b1c-333670f1a185 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:32.352312 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b4f99-6d49-4c58-8b1c-333670f1a185 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:32.368223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b4f99-6d49-4c58-8b1c-333670f1a185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-c60b4f99-6d49-4c58-8b1c-333670f1a185 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:32.376466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:32.377317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:32.378554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 72/144] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:32.383605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7de9fb-348b-4567-ac94-37f1f48fb15c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:32.488052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:32.523531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7de9fb-348b-4567-ac94-37f1f48fb15c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:32.561718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8b0c1-dc2c-4b78-92ff-ded5864ce574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:32.562393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b0c1-dc2c-4b78-92ff-ded5864ce574 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:32.562679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b0c1-dc2c-4b78-92ff-ded5864ce574 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:32.562956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b0c1-dc2c-4b78-92ff-ded5864ce574 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:32.563684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8b0c1-dc2c-4b78-92ff-ded5864ce574 None admin] RBAC: Adding query filter params (name=member) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:32.563987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8b0c1-dc2c-4b78-92ff-ded5864ce574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:32.565391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8b0c1-dc2c-4b78-92ff-ded5864ce574 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:32.575450 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 73/145] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:32.587411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b4f99-6d49-4c58-8b1c-333670f1a185 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:32.705072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b4f99-6d49-4c58-8b1c-333670f1a185 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:32.746478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6a56b-618f-40fe-a7f8-b239bfc52706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:32.747387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6a56b-618f-40fe-a7f8-b239bfc52706 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:32.747676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6a56b-618f-40fe-a7f8-b239bfc52706 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:32.748018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6a56b-618f-40fe-a7f8-b239bfc52706 None admin] PATH_INFO: `/v3/users/e0489743915a4b6fb0142190909fa24c` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:32.749304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6a56b-618f-40fe-a7f8-b239bfc52706 None admin] RBAC: Authorizing `identity:get_user(user_id=e0489743915a4b6fb0142190909fa24c)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:32.750898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6a56b-618f-40fe-a7f8-b239bfc52706 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:32.758405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 73/146] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:32 2022] GET /identity/v3/users/e0489743915a4b6fb0142190909fa24c => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:32.768622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8b0c1-dc2c-4b78-92ff-ded5864ce574 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:32.889982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8b0c1-dc2c-4b78-92ff-ded5864ce574 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:32.924070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:32.929512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09070f-9af3-4967-9617-dabead7d2d24 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:32.929802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09070f-9af3-4967-9617-dabead7d2d24 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:32.930096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09070f-9af3-4967-9617-dabead7d2d24 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:32.931754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 74/147] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:32.935081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739bddc-44da-49e5-a812-dfb1c4eb1976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:32.939368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739bddc-44da-49e5-a812-dfb1c4eb1976 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:32.939368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739bddc-44da-49e5-a812-dfb1c4eb1976 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:32.939368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739bddc-44da-49e5-a812-dfb1c4eb1976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:32.940994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea76f23-bcf7-4161-adcd-ecd0bb128f3e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:32.941279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea76f23-bcf7-4161-adcd-ecd0bb128f3e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:32.941556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea76f23-bcf7-4161-adcd-ecd0bb128f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:32.970984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-6ea76f23-bcf7-4161-adcd-ecd0bb128f3e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:32.972186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6ea76f23-bcf7-4161-adcd-ecd0bb128f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:33.070545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:33.087011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739bddc-44da-49e5-a812-dfb1c4eb1976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:33.090229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739bddc-44da-49e5-a812-dfb1c4eb1976 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:33.107442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 75/148] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:33.109109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffce8d-e593-49bc-9fa9-01b530b8e921 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:33.109591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffce8d-e593-49bc-9fa9-01b530b8e921 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:33.110061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffce8d-e593-49bc-9fa9-01b530b8e921 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:33.113284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 76/149] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:33.118690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12744-f212-4ea3-94bd-cc6bfc8f2ce1 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:33.119228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12744-f212-4ea3-94bd-cc6bfc8f2ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:33.119699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12744-f212-4ea3-94bd-cc6bfc8f2ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:33.151963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-46f12744-f212-4ea3-94bd-cc6bfc8f2ce1 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:33.154701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-46f12744-f212-4ea3-94bd-cc6bfc8f2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:33.255767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 77/150] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:33.256753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f12744-f212-4ea3-94bd-cc6bfc8f2ce1 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:33.260477 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 74/151] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:33.271223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739bddc-44da-49e5-a812-dfb1c4eb1976 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:33.313294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:33.368045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f12744-f212-4ea3-94bd-cc6bfc8f2ce1 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:33.394169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:33.416723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739bddc-44da-49e5-a812-dfb1c4eb1976 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:33.424146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97865b6d-5064-4380-a14c-c41bc2ef5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:33.424830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865b6d-5064-4380-a14c-c41bc2ef5e55 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:33.425110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865b6d-5064-4380-a14c-c41bc2ef5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:33.425853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865b6d-5064-4380-a14c-c41bc2ef5e55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:33.450425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97865b6d-5064-4380-a14c-c41bc2ef5e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-97865b6d-5064-4380-a14c-c41bc2ef5e55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:33.456872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:33.457714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:33.458510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 78/152] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:33.459129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97865b6d-5064-4380-a14c-c41bc2ef5e55 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:33.481376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082b17f-28dc-4222-a4e8-1419cb3264a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:33.482047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082b17f-28dc-4222-a4e8-1419cb3264a3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:33.482343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082b17f-28dc-4222-a4e8-1419cb3264a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:33.482623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082b17f-28dc-4222-a4e8-1419cb3264a3 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:33.483969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082b17f-28dc-4222-a4e8-1419cb3264a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:33.485428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082b17f-28dc-4222-a4e8-1419cb3264a3 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:33.487155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 75/153] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:33 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:33.487934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082b17f-28dc-4222-a4e8-1419cb3264a3 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:33.629086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:33.633903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082b17f-28dc-4222-a4e8-1419cb3264a3 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:33.669546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97865b6d-5064-4380-a14c-c41bc2ef5e55 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:33.675684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5d2e3-fccb-4b60-b8ac-982616b97b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:33.676619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5d2e3-fccb-4b60-b8ac-982616b97b04 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:33.677151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5d2e3-fccb-4b60-b8ac-982616b97b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:33.677682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5d2e3-fccb-4b60-b8ac-982616b97b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:33.678652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5d2e3-fccb-4b60-b8ac-982616b97b04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:33.679412 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5d2e3-fccb-4b60-b8ac-982616b97b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:33.681124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5d2e3-fccb-4b60-b8ac-982616b97b04 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:33.691102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 76/154] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:33.692189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5d2e3-fccb-4b60-b8ac-982616b97b04 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:33.748804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5b99d-88ee-408f-a7ea-007f74fff46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:33.749872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b99d-88ee-408f-a7ea-007f74fff46e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:33.750396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b99d-88ee-408f-a7ea-007f74fff46e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:33.750867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b99d-88ee-408f-a7ea-007f74fff46e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:33.772179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5b99d-88ee-408f-a7ea-007f74fff46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-2cb5b99d-88ee-408f-a7ea-007f74fff46e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:33.778921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:33.779874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:33.780633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:33.783074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 79/155] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:33.784074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5b99d-88ee-408f-a7ea-007f74fff46e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:33.828383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:33.914826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5b99d-88ee-408f-a7ea-007f74fff46e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:33.937003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5d2e3-fccb-4b60-b8ac-982616b97b04 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:33.966252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62fe95-e69a-40e5-b9b1-a26785be581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:33.967293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62fe95-e69a-40e5-b9b1-a26785be581f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:33.967777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62fe95-e69a-40e5-b9b1-a26785be581f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:33.968249 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62fe95-e69a-40e5-b9b1-a26785be581f None admin] PATH_INFO: `/v3/users/f05e7fd80c5e4d9a91d436aef7c641b1` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:33.969923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62fe95-e69a-40e5-b9b1-a26785be581f None admin] RBAC: Authorizing `identity:get_user(user_id=f05e7fd80c5e4d9a91d436aef7c641b1)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:33.976286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62fe95-e69a-40e5-b9b1-a26785be581f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:33.978145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 80/156] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:33 2022] GET /identity/v3/users/f05e7fd80c5e4d9a91d436aef7c641b1 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:33.979139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62fe95-e69a-40e5-b9b1-a26785be581f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:33.991528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e8e14-3d5c-4e6c-9ce6-eba66e7f38b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:33.992456 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e8e14-3d5c-4e6c-9ce6-eba66e7f38b8 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:33.994604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e8e14-3d5c-4e6c-9ce6-eba66e7f38b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:33.995139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e8e14-3d5c-4e6c-9ce6-eba66e7f38b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:33.996191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e8e14-3d5c-4e6c-9ce6-eba66e7f38b8 None admin] RBAC: Adding query filter params (role.id=135a36507984447394cee2c2924414bb, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7, user.id=e0489743915a4b6fb0142190909fa24c) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:34.002878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e8e14-3d5c-4e6c-9ce6-eba66e7f38b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:34.004742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e8e14-3d5c-4e6c-9ce6-eba66e7f38b8 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:34.013282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 77/157] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:33 2022] GET /identity/v3/role_assignments?user.id=e0489743915a4b6fb0142190909fa24c&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=135a36507984447394cee2c2924414bb => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:34.014384 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e8e14-3d5c-4e6c-9ce6-eba66e7f38b8 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:34.063497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:34.198845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62fe95-e69a-40e5-b9b1-a26785be581f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:34.214576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:34.219075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e8e14-3d5c-4e6c-9ce6-eba66e7f38b8 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:34.265991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4475218-f70b-4922-b2e1-14e0f8efb694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:34.266661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4475218-f70b-4922-b2e1-14e0f8efb694 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:34.266935 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4475218-f70b-4922-b2e1-14e0f8efb694 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:34.267201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4475218-f70b-4922-b2e1-14e0f8efb694 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:34.267920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4475218-f70b-4922-b2e1-14e0f8efb694 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:34.268214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4475218-f70b-4922-b2e1-14e0f8efb694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:34.269576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4475218-f70b-4922-b2e1-14e0f8efb694 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:34.292004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 81/158] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:34.293289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f25cc0-fb24-4346-9911-6f8607422033 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:34.294096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f25cc0-fb24-4346-9911-6f8607422033 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:34.294401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f25cc0-fb24-4346-9911-6f8607422033 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:34.295616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 82/159] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:34.303489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26129154-c076-4d8d-8172-72eb8d061688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:34.304587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26129154-c076-4d8d-8172-72eb8d061688 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:34.305074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26129154-c076-4d8d-8172-72eb8d061688 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:34.305572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26129154-c076-4d8d-8172-72eb8d061688 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:34.311141 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f25cc0-fb24-4346-9911-6f8607422033 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:34.311292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26129154-c076-4d8d-8172-72eb8d061688 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:34.314013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26129154-c076-4d8d-8172-72eb8d061688 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:34.317312 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 78/160] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:34 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:34.326376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c6001-c30a-4719-8938-f91f881b3757 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:34.326858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c6001-c30a-4719-8938-f91f881b3757 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:34.327330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c6001-c30a-4719-8938-f91f881b3757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:34.379374 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c65c6001-c30a-4719-8938-f91f881b3757 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:34.381121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c65c6001-c30a-4719-8938-f91f881b3757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:34.520521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 79/161] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 04 05:05:34.522529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c6001-c30a-4719-8938-f91f881b3757 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:34.539571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f25cc0-fb24-4346-9911-6f8607422033 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:34.575413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:34.623956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c621-1ef8-4c5a-913d-22490fe95907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:34.624964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c621-1ef8-4c5a-913d-22490fe95907 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:34.626598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c621-1ef8-4c5a-913d-22490fe95907 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:34.627100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c621-1ef8-4c5a-913d-22490fe95907 None admin] PATH_INFO: `/v3/users/75b3532d53944d4789f9bd6bd6ab00cf` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:34.628709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49c621-1ef8-4c5a-913d-22490fe95907 None admin] RBAC: Authorizing `identity:get_user(user_id=75b3532d53944d4789f9bd6bd6ab00cf)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:34.631071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49c621-1ef8-4c5a-913d-22490fe95907 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:34.634607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 83/162] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:34 2022] GET /identity/v3/users/75b3532d53944d4789f9bd6bd6ab00cf => generated 247 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:34.636558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c621-1ef8-4c5a-913d-22490fe95907 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:34.710824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c6001-c30a-4719-8938-f91f881b3757 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:34.712176 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:34.784773 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e48625-56a4-4ef2-bd39-45bbdc24a4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:34.785805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e48625-56a4-4ef2-bd39-45bbdc24a4c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:34.786290 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e48625-56a4-4ef2-bd39-45bbdc24a4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:34.786797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e48625-56a4-4ef2-bd39-45bbdc24a4c5 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/users/f05e7fd80c5e4d9a91d436aef7c641b1/roles/99363062b2b644ee970fba81eb1e5f45` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:34.789534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e48625-56a4-4ef2-bd39-45bbdc24a4c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c79dd8e7e16b41ea974aa6b292b8aec7, user_id=f05e7fd80c5e4d9a91d436aef7c641b1, role_id=99363062b2b644ee970fba81eb1e5f45)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:34.791414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e48625-56a4-4ef2-bd39-45bbdc24a4c5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:34.823144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c621-1ef8-4c5a-913d-22490fe95907 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:34.870698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4c75e-0977-47ed-98df-b4971d3ac47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:34.872413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4c75e-0977-47ed-98df-b4971d3ac47b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:34.872914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4c75e-0977-47ed-98df-b4971d3ac47b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:34.873495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4c75e-0977-47ed-98df-b4971d3ac47b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:34.888663 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4c75e-0977-47ed-98df-b4971d3ac47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-21f4c75e-0977-47ed-98df-b4971d3ac47b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:34.894720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:34.895639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:34.896407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:34.898782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 84/163] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:34.899755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4c75e-0977-47ed-98df-b4971d3ac47b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:34.921549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 80/164] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:05:34 2022] PUT /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/users/f05e7fd80c5e4d9a91d436aef7c641b1/roles/99363062b2b644ee970fba81eb1e5f45 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:05:34.922947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e48625-56a4-4ef2-bd39-45bbdc24a4c5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:35.077031 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:35.084441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4c75e-0977-47ed-98df-b4971d3ac47b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:35.128029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5300b6-ad64-449a-b8b8-6142bba2f59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:35.129062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5300b6-ad64-449a-b8b8-6142bba2f59c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:35.129539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5300b6-ad64-449a-b8b8-6142bba2f59c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:35.130011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5300b6-ad64-449a-b8b8-6142bba2f59c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:35.132279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:35.183243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e48625-56a4-4ef2-bd39-45bbdc24a4c5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:35.274788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc87271-c8ba-4d7c-ae6f-4daf01549830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:35.275415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc87271-c8ba-4d7c-ae6f-4daf01549830 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:35.275673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc87271-c8ba-4d7c-ae6f-4daf01549830 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:35.275942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc87271-c8ba-4d7c-ae6f-4daf01549830 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:35.276667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc87271-c8ba-4d7c-ae6f-4daf01549830 None admin] RBAC: Adding query filter params (name=member) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:35.276965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc87271-c8ba-4d7c-ae6f-4daf01549830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:35.279605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc87271-c8ba-4d7c-ae6f-4daf01549830 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:35.301371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 81/165] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:35.302490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5300b6-ad64-449a-b8b8-6142bba2f59c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:35.303951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5300b6-ad64-449a-b8b8-6142bba2f59c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:35.307643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc87271-c8ba-4d7c-ae6f-4daf01549830 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:35.517710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:35.527623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 85/166] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:35.530138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e354644-1225-4aeb-9db7-ebae756bc8e2 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:35.535652 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e354644-1225-4aeb-9db7-ebae756bc8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:35.535936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e354644-1225-4aeb-9db7-ebae756bc8e2 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:35.538132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 86/167] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:35.540489 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e354644-1225-4aeb-9db7-ebae756bc8e2 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:35.585007 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc87271-c8ba-4d7c-ae6f-4daf01549830 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:35.683671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fdf6a-e970-4183-9ede-86de5dce19d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:35.684352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fdf6a-e970-4183-9ede-86de5dce19d4 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:35.685149 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fdf6a-e970-4183-9ede-86de5dce19d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:35.685424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fdf6a-e970-4183-9ede-86de5dce19d4 None admin] PATH_INFO: `/v3/users/e0489743915a4b6fb0142190909fa24c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:35.687040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fdf6a-e970-4183-9ede-86de5dce19d4 None admin] RBAC: Authorizing `identity:get_user(user_id=e0489743915a4b6fb0142190909fa24c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:35.688496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fdf6a-e970-4183-9ede-86de5dce19d4 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:35.690101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 82/168] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:35 2022] GET /identity/v3/users/e0489743915a4b6fb0142190909fa24c => generated 275 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:35.691251 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcf0c4-4da4-41d7-8bcb-b6230edabd74 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:35.691529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcf0c4-4da4-41d7-8bcb-b6230edabd74 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:35.691799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcf0c4-4da4-41d7-8bcb-b6230edabd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:35.739803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-cbdcf0c4-4da4-41d7-8bcb-b6230edabd74 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:35.740978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cbdcf0c4-4da4-41d7-8bcb-b6230edabd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:35.760664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:35.806399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e354644-1225-4aeb-9db7-ebae756bc8e2 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:35.855037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18774b70-7911-4ff4-bc53-75cb5ab6966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:35.855694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18774b70-7911-4ff4-bc53-75cb5ab6966c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:35.855971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18774b70-7911-4ff4-bc53-75cb5ab6966c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:35.856335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18774b70-7911-4ff4-bc53-75cb5ab6966c None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:35.857561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18774b70-7911-4ff4-bc53-75cb5ab6966c None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:35.859045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18774b70-7911-4ff4-bc53-75cb5ab6966c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:35.861086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 87/169] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:35 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:35.865600 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18774b70-7911-4ff4-bc53-75cb5ab6966c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:35.932765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 83/170] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:35.933458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcf0c4-4da4-41d7-8bcb-b6230edabd74 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:35.958690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:35.996310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18774b70-7911-4ff4-bc53-75cb5ab6966c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:36.034798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cbc54-7f1a-476e-bf97-148ad9a68d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:36.035418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cbc54-7f1a-476e-bf97-148ad9a68d66 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.035689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cbc54-7f1a-476e-bf97-148ad9a68d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.035954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cbc54-7f1a-476e-bf97-148ad9a68d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.109785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cbc54-7f1a-476e-bf97-148ad9a68d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:36.111348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cbc54-7f1a-476e-bf97-148ad9a68d66 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:36.194695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:36.217060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcf0c4-4da4-41d7-8bcb-b6230edabd74 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:36.226899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 88/171] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:36.233303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547970c1-4b5e-4296-a7fb-6c4e7f05ca50 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.233593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547970c1-4b5e-4296-a7fb-6c4e7f05ca50 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.233865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547970c1-4b5e-4296-a7fb-6c4e7f05ca50 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.235494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 89/172] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:36.236211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547970c1-4b5e-4296-a7fb-6c4e7f05ca50 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:36.301527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231379a-7fd6-4d2e-aeaf-d9b80e019627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:36.302199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231379a-7fd6-4d2e-aeaf-d9b80e019627 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.302446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231379a-7fd6-4d2e-aeaf-d9b80e019627 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.302708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231379a-7fd6-4d2e-aeaf-d9b80e019627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.303496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231379a-7fd6-4d2e-aeaf-d9b80e019627 None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7, user.id=75b3532d53944d4789f9bd6bd6ab00cf) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:36.303798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231379a-7fd6-4d2e-aeaf-d9b80e019627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:36.305238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231379a-7fd6-4d2e-aeaf-d9b80e019627 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:36.316112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 84/173] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:35 2022] GET /identity/v3/role_assignments?user.id=75b3532d53944d4789f9bd6bd6ab00cf&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 608 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:36.317878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231379a-7fd6-4d2e-aeaf-d9b80e019627 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:36.330719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:36.403401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547970c1-4b5e-4296-a7fb-6c4e7f05ca50 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:36.471944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5962a-db04-479c-9660-08d9cda10b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:36.472594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5962a-db04-479c-9660-08d9cda10b2a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.472868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5962a-db04-479c-9660-08d9cda10b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.473133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5962a-db04-479c-9660-08d9cda10b2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.502262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5962a-db04-479c-9660-08d9cda10b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-19a5962a-db04-479c-9660-08d9cda10b2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:36.507355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:36.508325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:36.509099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 90/174] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:05:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:36.510841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68182-2687-4738-bf42-2a5f98dee88d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.511136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68182-2687-4738-bf42-2a5f98dee88d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.511367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68182-2687-4738-bf42-2a5f98dee88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.540473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231379a-7fd6-4d2e-aeaf-d9b80e019627 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:36.544844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-37b68182-2687-4738-bf42-2a5f98dee88d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:36.546378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-37b68182-2687-4738-bf42-2a5f98dee88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:36.584995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:36.586256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104884ee-2478-46cd-9bbf-08a99172cf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:36.587160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104884ee-2478-46cd-9bbf-08a99172cf63 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.587575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104884ee-2478-46cd-9bbf-08a99172cf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.587984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104884ee-2478-46cd-9bbf-08a99172cf63 None admin] PATH_INFO: `/v3/projects/7dadd13d4c504c35aae22cc8658eafdd` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.589343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104884ee-2478-46cd-9bbf-08a99172cf63 None admin] RBAC: Authorizing `identity:get_project(project_id=7dadd13d4c504c35aae22cc8658eafdd)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:36.592845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104884ee-2478-46cd-9bbf-08a99172cf63 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:36.600564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 85/175] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:36 2022] GET /identity/v3/projects/7dadd13d4c504c35aae22cc8658eafdd => generated 312 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:36.600564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f269-2eb3-46c7-8bf4-5ab9ae4fd2b3 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.600564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f269-2eb3-46c7-8bf4-5ab9ae4fd2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.600564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f269-2eb3-46c7-8bf4-5ab9ae4fd2b3 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.600564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 86/176] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:36.603169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102f269-2eb3-46c7-8bf4-5ab9ae4fd2b3 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:36.655735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 91/177] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:36.657638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5de5e9-79f7-4b30-853c-7a0abda6862f None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.658113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5de5e9-79f7-4b30-853c-7a0abda6862f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.658601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5de5e9-79f7-4b30-853c-7a0abda6862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.688620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ca5de5e9-79f7-4b30-853c-7a0abda6862f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:36.689818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ca5de5e9-79f7-4b30-853c-7a0abda6862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:36.717523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:36.750846 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102f269-2eb3-46c7-8bf4-5ab9ae4fd2b3 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:36.786396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 92/178] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:36.787271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5de5e9-79f7-4b30-853c-7a0abda6862f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:36.808751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb47b4-eec5-44c5-b74c-6353d5de6eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:36.809763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb47b4-eec5-44c5-b74c-6353d5de6eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.810379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb47b4-eec5-44c5-b74c-6353d5de6eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.810760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb47b4-eec5-44c5-b74c-6353d5de6eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.811400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb47b4-eec5-44c5-b74c-6353d5de6eb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:36.812220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb47b4-eec5-44c5-b74c-6353d5de6eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:36.813902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb47b4-eec5-44c5-b74c-6353d5de6eb7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:36.826267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 87/179] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:05:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:36.827518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb47b4-eec5-44c5-b74c-6353d5de6eb7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:36.876503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:36.892423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5de5e9-79f7-4b30-853c-7a0abda6862f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:36.929122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be71a6d-07e6-4934-9c63-81efcb59987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:36.929654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71a6d-07e6-4934-9c63-81efcb59987e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.929929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71a6d-07e6-4934-9c63-81efcb59987e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.930196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71a6d-07e6-4934-9c63-81efcb59987e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.931016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be71a6d-07e6-4934-9c63-81efcb59987e None admin] RBAC: Adding query filter params (role.id=135a36507984447394cee2c2924414bb, scope.project.id=7dadd13d4c504c35aae22cc8658eafdd, user.id=e0489743915a4b6fb0142190909fa24c) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:36.931315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be71a6d-07e6-4934-9c63-81efcb59987e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:36.932785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be71a6d-07e6-4934-9c63-81efcb59987e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:36.945659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 93/180] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:36 2022] GET /identity/v3/role_assignments?user.id=e0489743915a4b6fb0142190909fa24c&scope.project.id=7dadd13d4c504c35aae22cc8658eafdd&role.id=135a36507984447394cee2c2924414bb => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:36.945659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5d5ff-5e34-43fc-a920-a0aa4a3f0b04 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.945659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5d5ff-5e34-43fc-a920-a0aa4a3f0b04 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.945659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5d5ff-5e34-43fc-a920-a0aa4a3f0b04 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.945659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 94/181] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:36.945659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5d5ff-5e34-43fc-a920-a0aa4a3f0b04 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:36.946195 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb47b4-eec5-44c5-b74c-6353d5de6eb7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:36.987629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7dfd3-9b4b-4d6d-ad5a-afc535cc5c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:36.988614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7dfd3-9b4b-4d6d-ad5a-afc535cc5c30 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:36.989122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7dfd3-9b4b-4d6d-ad5a-afc535cc5c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:36.989534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7dfd3-9b4b-4d6d-ad5a-afc535cc5c30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:36.993116 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:37.004916 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7dfd3-9b4b-4d6d-ad5a-afc535cc5c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-a3e7dfd3-9b4b-4d6d-ad5a-afc535cc5c30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:37.010534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:37.011658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:37.013321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:37.015341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 88/182] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:37.016316 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7dfd3-9b4b-4d6d-ad5a-afc535cc5c30 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:37.079909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5d5ff-5e34-43fc-a920-a0aa4a3f0b04 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:37.117425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e9ad9-f383-4d90-96a6-a99ed0dca2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:37.118065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9ad9-f383-4d90-96a6-a99ed0dca2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.118408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9ad9-f383-4d90-96a6-a99ed0dca2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.118677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9ad9-f383-4d90-96a6-a99ed0dca2d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.119916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e9ad9-f383-4d90-96a6-a99ed0dca2d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:37.121463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e9ad9-f383-4d90-96a6-a99ed0dca2d9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:37.123437 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 95/183] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:37.124566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71ab0-e3f1-4afc-8122-9009d8c861d5 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.124844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71ab0-e3f1-4afc-8122-9009d8c861d5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.129671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71ab0-e3f1-4afc-8122-9009d8c861d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.139480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7dfd3-9b4b-4d6d-ad5a-afc535cc5c30 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:37.149381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b8d71ab0-e3f1-4afc-8122-9009d8c861d5 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:37.150587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b8d71ab0-e3f1-4afc-8122-9009d8c861d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:37.163313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:37.193432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb577-b910-409f-9b77-ccd8df0a2134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:37.193998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb577-b910-409f-9b77-ccd8df0a2134 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.194276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb577-b910-409f-9b77-ccd8df0a2134 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.194638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb577-b910-409f-9b77-ccd8df0a2134 None admin] PATH_INFO: `/v3/users/e0489743915a4b6fb0142190909fa24c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.195839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeb577-b910-409f-9b77-ccd8df0a2134 None admin] RBAC: Authorizing `identity:get_user(user_id=e0489743915a4b6fb0142190909fa24c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:37.197293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeb577-b910-409f-9b77-ccd8df0a2134 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:37.199167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 89/184] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:37 2022] GET /identity/v3/users/e0489743915a4b6fb0142190909fa24c => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:37.199706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb577-b910-409f-9b77-ccd8df0a2134 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:37.234384 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 96/185] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:37.235359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d71ab0-e3f1-4afc-8122-9009d8c861d5 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:37.284191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:37.324737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb577-b910-409f-9b77-ccd8df0a2134 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:37.344431 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d71ab0-e3f1-4afc-8122-9009d8c861d5 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:37.359436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588f43b-76a3-43f4-8667-c736d1bcccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:37.360049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588f43b-76a3-43f4-8667-c736d1bcccb7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.360327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588f43b-76a3-43f4-8667-c736d1bcccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.360596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588f43b-76a3-43f4-8667-c736d1bcccb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.361305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588f43b-76a3-43f4-8667-c736d1bcccb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:37.361603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588f43b-76a3-43f4-8667-c736d1bcccb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:37.363007 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588f43b-76a3-43f4-8667-c736d1bcccb7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:37.376205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 90/186] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:37.376205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588f43b-76a3-43f4-8667-c736d1bcccb7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:37.388892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f575f-7be9-4a61-a93f-d8d232ed35d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:37.389651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f575f-7be9-4a61-a93f-d8d232ed35d0 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.389934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f575f-7be9-4a61-a93f-d8d232ed35d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.390209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f575f-7be9-4a61-a93f-d8d232ed35d0 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.390984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f575f-7be9-4a61-a93f-d8d232ed35d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:37.392831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f575f-7be9-4a61-a93f-d8d232ed35d0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:37.473831 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588f43b-76a3-43f4-8667-c736d1bcccb7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:37.494920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 97/187] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:05:37 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:37.502588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f575f-7be9-4a61-a93f-d8d232ed35d0 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:37.502588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:37.508966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:37.521125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4a11c-f0ec-4130-98b1-6cc91e3ccce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:37.521764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a11c-f0ec-4130-98b1-6cc91e3ccce0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.522039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a11c-f0ec-4130-98b1-6cc91e3ccce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.522423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4a11c-f0ec-4130-98b1-6cc91e3ccce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.611226 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4a11c-f0ec-4130-98b1-6cc91e3ccce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:37.612800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4a11c-f0ec-4130-98b1-6cc91e3ccce0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:37.615902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f575f-7be9-4a61-a93f-d8d232ed35d0 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:37.655284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d2e81-b485-4bbe-952c-b1d21f03d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:37.655942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d2e81-b485-4bbe-952c-b1d21f03d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.656220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d2e81-b485-4bbe-952c-b1d21f03d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.656495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d2e81-b485-4bbe-952c-b1d21f03d9e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.669277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d2e81-b485-4bbe-952c-b1d21f03d9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-b29d2e81-b485-4bbe-952c-b1d21f03d9e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:37.675053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:37.675912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:37.676705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 98/188] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:05:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:37.677344 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d2e81-b485-4bbe-952c-b1d21f03d9e0 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:37.743832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 91/189] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:37.745569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0948e-560d-4f56-b081-269caa4c90ed None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.745919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0948e-560d-4f56-b081-269caa4c90ed None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.746205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0948e-560d-4f56-b081-269caa4c90ed None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.747721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 92/190] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:37.748257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0948e-560d-4f56-b081-269caa4c90ed None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:37.759196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:37.783914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:37.808872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d2e81-b485-4bbe-952c-b1d21f03d9e0 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:37.848310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879aab0-7821-4fb6-b5df-b2710a3a761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:37.848957 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879aab0-7821-4fb6-b5df-b2710a3a761a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.849348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879aab0-7821-4fb6-b5df-b2710a3a761a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.849622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879aab0-7821-4fb6-b5df-b2710a3a761a None admin] PATH_INFO: `/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.869001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879aab0-7821-4fb6-b5df-b2710a3a761a None admin] RBAC: Authorizing `identity:get_user(user_id=f8c5f8b4499a41f5a0d8f0572b3750e4)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:37.870762 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879aab0-7821-4fb6-b5df-b2710a3a761a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:37.872711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 99/191] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:37 2022] GET /identity/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:37.872829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0948e-560d-4f56-b081-269caa4c90ed None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:37.877665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879aab0-7821-4fb6-b5df-b2710a3a761a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:37.924463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fbccd-cbbf-40d7-bdb9-397184c237bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:37.925087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fbccd-cbbf-40d7-bdb9-397184c237bb None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.925366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fbccd-cbbf-40d7-bdb9-397184c237bb None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.925693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fbccd-cbbf-40d7-bdb9-397184c237bb None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.926494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fbccd-cbbf-40d7-bdb9-397184c237bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:37.926800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fbccd-cbbf-40d7-bdb9-397184c237bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:37.928222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fbccd-cbbf-40d7-bdb9-397184c237bb None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:37.939911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 93/192] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:05:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:37.941779 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3d6ee-a5b4-4e46-9730-cf0b3ac4b2e3 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:37.942068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3d6ee-a5b4-4e46-9730-cf0b3ac4b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:37.942366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3d6ee-a5b4-4e46-9730-cf0b3ac4b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:37.967346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-aba3d6ee-a5b4-4e46-9730-cf0b3ac4b2e3 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:37.968573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-aba3d6ee-a5b4-4e46-9730-cf0b3ac4b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:37.996302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879aab0-7821-4fb6-b5df-b2710a3a761a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:38.023843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:38.039596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99f719-c3b0-41dc-972f-e14ef3954c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:38.040417 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f719-c3b0-41dc-972f-e14ef3954c6d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:38.040836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f719-c3b0-41dc-972f-e14ef3954c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:38.041122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f719-c3b0-41dc-972f-e14ef3954c6d None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:38.042286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99f719-c3b0-41dc-972f-e14ef3954c6d None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:38.044247 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99f719-c3b0-41dc-972f-e14ef3954c6d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:38.046400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 100/193] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:37 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:38.047759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99f719-c3b0-41dc-972f-e14ef3954c6d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:38.053566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 94/194] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:38.054806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3d6ee-a5b4-4e46-9730-cf0b3ac4b2e3 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:38.076596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:38.171767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3d6ee-a5b4-4e46-9730-cf0b3ac4b2e3 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:38.196468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99f719-c3b0-41dc-972f-e14ef3954c6d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:38.209775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935c048-07c8-4b89-b8b1-9afcc8428d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:38.210466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935c048-07c8-4b89-b8b1-9afcc8428d79 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:38.210746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935c048-07c8-4b89-b8b1-9afcc8428d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:38.211017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935c048-07c8-4b89-b8b1-9afcc8428d79 None admin] PATH_INFO: `/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:38.212256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935c048-07c8-4b89-b8b1-9afcc8428d79 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c5f8b4499a41f5a0d8f0572b3750e4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:38.213726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935c048-07c8-4b89-b8b1-9afcc8428d79 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:38.220267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 95/195] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:38 2022] GET /identity/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:38.221232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935c048-07c8-4b89-b8b1-9afcc8428d79 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:38.241409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3267254-6c3f-4c9e-913d-9dc87c53040b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:38.242458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3267254-6c3f-4c9e-913d-9dc87c53040b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:38.242973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3267254-6c3f-4c9e-913d-9dc87c53040b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:38.243448 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3267254-6c3f-4c9e-913d-9dc87c53040b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:38.318856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:38.319220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:38.331072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935c048-07c8-4b89-b8b1-9afcc8428d79 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:38.336537 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3267254-6c3f-4c9e-913d-9dc87c53040b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:38.338193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3267254-6c3f-4c9e-913d-9dc87c53040b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:38.372443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dccdb6-ac83-4784-aa70-4d3cff61c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:38.373554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dccdb6-ac83-4784-aa70-4d3cff61c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:38.374703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dccdb6-ac83-4784-aa70-4d3cff61c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:38.375053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dccdb6-ac83-4784-aa70-4d3cff61c9d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:38.376372 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dccdb6-ac83-4784-aa70-4d3cff61c9d5 None admin] RBAC: Adding query filter params (role.id=ac5a79a4ca8d49298d455da9928e5a4f, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7, user.id=e0489743915a4b6fb0142190909fa24c) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:38.376755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dccdb6-ac83-4784-aa70-4d3cff61c9d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:38.378774 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dccdb6-ac83-4784-aa70-4d3cff61c9d5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:38.386398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 96/196] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:38 2022] GET /identity/v3/role_assignments?user.id=e0489743915a4b6fb0142190909fa24c&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=ac5a79a4ca8d49298d455da9928e5a4f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:38.391012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dccdb6-ac83-4784-aa70-4d3cff61c9d5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:38.501564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 101/197] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:38.503331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3267254-6c3f-4c9e-913d-9dc87c53040b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:38.602728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dccdb6-ac83-4784-aa70-4d3cff61c9d5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:38.648110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fb717-655c-4596-8952-0161bca7a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:38.649296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fb717-655c-4596-8952-0161bca7a481 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:38.649674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fb717-655c-4596-8952-0161bca7a481 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:38.650388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fb717-655c-4596-8952-0161bca7a481 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:38.662143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:38.665230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fb717-655c-4596-8952-0161bca7a481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-7c5fb717-655c-4596-8952-0161bca7a481 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:38.677853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:38.679653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:38.680444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:38.681834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3267254-6c3f-4c9e-913d-9dc87c53040b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:38.681932 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 97/198] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:38.684811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fb717-655c-4596-8952-0161bca7a481 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:38.698557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:38.726077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782dfb9-5837-466f-bc5b-bb8fabac4e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:38.726778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782dfb9-5837-466f-bc5b-bb8fabac4e2c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:38.727821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782dfb9-5837-466f-bc5b-bb8fabac4e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:38.728041 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782dfb9-5837-466f-bc5b-bb8fabac4e2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:38.870917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fb717-655c-4596-8952-0161bca7a481 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:38.875387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782dfb9-5837-466f-bc5b-bb8fabac4e2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:38.876968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782dfb9-5837-466f-bc5b-bb8fabac4e2c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:38.912699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc39d-11c1-413c-96d8-78b74b7e6507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:38.913337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc39d-11c1-413c-96d8-78b74b7e6507 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:38.913610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc39d-11c1-413c-96d8-78b74b7e6507 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:38.913876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc39d-11c1-413c-96d8-78b74b7e6507 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:38.915066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fc39d-11c1-413c-96d8-78b74b7e6507 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:38.916520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fc39d-11c1-413c-96d8-78b74b7e6507 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:38.918468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 98/199] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:38 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:38.918987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc39d-11c1-413c-96d8-78b74b7e6507 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:39.002345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:39.009957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:39.021835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 102/200] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:39.023019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782dfb9-5837-466f-bc5b-bb8fabac4e2c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:39.034168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc39d-11c1-413c-96d8-78b74b7e6507 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:39.077702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba7224-0c63-4692-852f-b0d26539012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:39.078727 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7224-0c63-4692-852f-b0d26539012a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:39.079868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7224-0c63-4692-852f-b0d26539012a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:39.080362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7224-0c63-4692-852f-b0d26539012a None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:39.081784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba7224-0c63-4692-852f-b0d26539012a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:39.082365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba7224-0c63-4692-852f-b0d26539012a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:39.084766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba7224-0c63-4692-852f-b0d26539012a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:39.096367 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 99/201] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:39.097768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba7224-0c63-4692-852f-b0d26539012a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:39.156244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782dfb9-5837-466f-bc5b-bb8fabac4e2c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:39.196145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad7856-590a-4cfd-a116-536602ff0dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:39.196713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad7856-590a-4cfd-a116-536602ff0dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:39.197094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad7856-590a-4cfd-a116-536602ff0dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:39.197465 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad7856-590a-4cfd-a116-536602ff0dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:39.198445 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad7856-590a-4cfd-a116-536602ff0dd5 None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=03f4d63223db43eb85dbf6a826df6875, user.id=f8c5f8b4499a41f5a0d8f0572b3750e4) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:39.198857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad7856-590a-4cfd-a116-536602ff0dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:39.201066 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad7856-590a-4cfd-a116-536602ff0dd5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:39.207094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 103/202] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:39 2022] GET /identity/v3/role_assignments?user.id=f8c5f8b4499a41f5a0d8f0572b3750e4&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:39.208033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad7856-590a-4cfd-a116-536602ff0dd5 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:39.229955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba7224-0c63-4692-852f-b0d26539012a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:39.268842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed9049-bd6e-4b7c-9ba7-5e1d35ae301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:39.269759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed9049-bd6e-4b7c-9ba7-5e1d35ae301d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:39.269919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:39.270337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed9049-bd6e-4b7c-9ba7-5e1d35ae301d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:39.270821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed9049-bd6e-4b7c-9ba7-5e1d35ae301d None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:39.272180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed9049-bd6e-4b7c-9ba7-5e1d35ae301d None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:39.273858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed9049-bd6e-4b7c-9ba7-5e1d35ae301d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:39.276903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 100/203] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:39 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:39.287442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed9049-bd6e-4b7c-9ba7-5e1d35ae301d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:39.305755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:39.332797 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad7856-590a-4cfd-a116-536602ff0dd5 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:39.369863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b829b-a5fa-4a4a-83c5-536901bf7700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:39.370544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b829b-a5fa-4a4a-83c5-536901bf7700 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:39.370871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b829b-a5fa-4a4a-83c5-536901bf7700 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:39.371151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b829b-a5fa-4a4a-83c5-536901bf7700 None admin] PATH_INFO: `/v3/users/f05e7fd80c5e4d9a91d436aef7c641b1` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:39.373122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b829b-a5fa-4a4a-83c5-536901bf7700 None admin] RBAC: Authorizing `identity:get_user(user_id=f05e7fd80c5e4d9a91d436aef7c641b1)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:39.375029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b829b-a5fa-4a4a-83c5-536901bf7700 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:39.377009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 104/204] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:39 2022] GET /identity/v3/users/f05e7fd80c5e4d9a91d436aef7c641b1 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:39.382641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b829b-a5fa-4a4a-83c5-536901bf7700 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:39.470940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed9049-bd6e-4b7c-9ba7-5e1d35ae301d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:39.510458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91b62d-2f27-4f22-8d42-6a4ec47f30af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:39.511342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91b62d-2f27-4f22-8d42-6a4ec47f30af None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:39.511635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91b62d-2f27-4f22-8d42-6a4ec47f30af None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:39.511919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91b62d-2f27-4f22-8d42-6a4ec47f30af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:39.512909 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91b62d-2f27-4f22-8d42-6a4ec47f30af None admin] RBAC: Adding query filter params (role.id=ac5a79a4ca8d49298d455da9928e5a4f, scope.project.id=03f4d63223db43eb85dbf6a826df6875, user.id=f8c5f8b4499a41f5a0d8f0572b3750e4) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:39.513295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91b62d-2f27-4f22-8d42-6a4ec47f30af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:39.514930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91b62d-2f27-4f22-8d42-6a4ec47f30af None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:39.521988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 101/205] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:39 2022] GET /identity/v3/role_assignments?user.id=f8c5f8b4499a41f5a0d8f0572b3750e4&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=ac5a79a4ca8d49298d455da9928e5a4f => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:39.563964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b829b-a5fa-4a4a-83c5-536901bf7700 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:39.587584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:39.602931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa9e21-75c0-4897-878b-a06b1138547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:39.603559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9e21-75c0-4897-878b-a06b1138547e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:39.603837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9e21-75c0-4897-878b-a06b1138547e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:39.604108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9e21-75c0-4897-878b-a06b1138547e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:39.679594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa9e21-75c0-4897-878b-a06b1138547e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:39.681064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa9e21-75c0-4897-878b-a06b1138547e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:39.794367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 105/206] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:39.803602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91b62d-2f27-4f22-8d42-6a4ec47f30af None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:39.870293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6280880-17fd-4cab-b70e-df92cc925e4d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:39.870627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6280880-17fd-4cab-b70e-df92cc925e4d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:39.870869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6280880-17fd-4cab-b70e-df92cc925e4d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:39.873074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 106/207] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:05:39.879420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296ac2-5dc1-4615-9a99-37465c919283 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:39.879708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296ac2-5dc1-4615-9a99-37465c919283 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:39.879971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296ac2-5dc1-4615-9a99-37465c919283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:39.896619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:39.901411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b3296ac2-5dc1-4615-9a99-37465c919283 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:39.903686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b3296ac2-5dc1-4615-9a99-37465c919283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:39.922740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:39.952528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91b62d-2f27-4f22-8d42-6a4ec47f30af None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:39.984452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 107/208] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:40.010007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296ac2-5dc1-4615-9a99-37465c919283 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:40.033247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf4a58-136f-4507-b3cf-f92bc40bd119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:40.033966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf4a58-136f-4507-b3cf-f92bc40bd119 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:40.034246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf4a58-136f-4507-b3cf-f92bc40bd119 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:40.034543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf4a58-136f-4507-b3cf-f92bc40bd119 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:40.036012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf4a58-136f-4507-b3cf-f92bc40bd119 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:40.043825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf4a58-136f-4507-b3cf-f92bc40bd119 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:40.045766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 102/209] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:39 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:40.051974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df07c29-0465-4767-b8df-0db0a11699c0 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:40.052259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df07c29-0465-4767-b8df-0db0a11699c0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:40.052538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df07c29-0465-4767-b8df-0db0a11699c0 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:40.054081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 103/210] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:40.055102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df07c29-0465-4767-b8df-0db0a11699c0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:40.131435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296ac2-5dc1-4615-9a99-37465c919283 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:40.161761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df07c29-0465-4767-b8df-0db0a11699c0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:40.177900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cba30-a92f-4777-a7ce-6c964ccba01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:40.178455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cba30-a92f-4777-a7ce-6c964ccba01e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:40.178738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cba30-a92f-4777-a7ce-6c964ccba01e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:40.179010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cba30-a92f-4777-a7ce-6c964ccba01e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:40.201266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0343a1-221f-422d-8eb9-14276852eccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:40.202270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0343a1-221f-422d-8eb9-14276852eccb None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:40.202812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0343a1-221f-422d-8eb9-14276852eccb None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:40.203313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0343a1-221f-422d-8eb9-14276852eccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:40.203971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cba30-a92f-4777-a7ce-6c964ccba01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:40.204556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0343a1-221f-422d-8eb9-14276852eccb None admin] RBAC: Adding query filter params (role.id=99363062b2b644ee970fba81eb1e5f45, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7, user.id=f05e7fd80c5e4d9a91d436aef7c641b1) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:40.205059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0343a1-221f-422d-8eb9-14276852eccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:40.206784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0343a1-221f-422d-8eb9-14276852eccb None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-963cba30-a92f-4777-a7ce-6c964ccba01e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:40.209236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:40.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:40.210922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:40.214381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 108/211] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:40.217868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb005-0f00-4ca5-bd45-34a6a4bd0519 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:40.218147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb005-0f00-4ca5-bd45-34a6a4bd0519 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:40.218443 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb005-0f00-4ca5-bd45-34a6a4bd0519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:40.223874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 104/212] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:40 2022] GET /identity/v3/role_assignments?user.id=f05e7fd80c5e4d9a91d436aef7c641b1&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=99363062b2b644ee970fba81eb1e5f45 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:40.224524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0343a1-221f-422d-8eb9-14276852eccb None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:40.231415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:40.241939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-e8ccb005-0f00-4ca5-bd45-34a6a4bd0519 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:40.264457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e8ccb005-0f00-4ca5-bd45-34a6a4bd0519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:40.264457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:40.322018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 109/213] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:40.349688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccb005-0f00-4ca5-bd45-34a6a4bd0519 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:40.362060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0343a1-221f-422d-8eb9-14276852eccb None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:40.404397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9c012-74b0-413d-8e79-8aa2e0546734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:40.405522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9c012-74b0-413d-8e79-8aa2e0546734 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:40.406003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9c012-74b0-413d-8e79-8aa2e0546734 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:40.406506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9c012-74b0-413d-8e79-8aa2e0546734 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:40.407437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9c012-74b0-413d-8e79-8aa2e0546734 None admin] RBAC: Adding query filter params (name=member) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:40.407963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9c012-74b0-413d-8e79-8aa2e0546734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:40.410365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9c012-74b0-413d-8e79-8aa2e0546734 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:40.426198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 105/214] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:40.428750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9c012-74b0-413d-8e79-8aa2e0546734 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:40.515922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:40.557500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccb005-0f00-4ca5-bd45-34a6a4bd0519 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:40.574340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9c012-74b0-413d-8e79-8aa2e0546734 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:40.605345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312247d-7d8c-475d-b306-559241c6f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:40.607244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312247d-7d8c-475d-b306-559241c6f910 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:40.607528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312247d-7d8c-475d-b306-559241c6f910 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:40.608098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312247d-7d8c-475d-b306-559241c6f910 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:40.609590 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312247d-7d8c-475d-b306-559241c6f910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:40.611836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312247d-7d8c-475d-b306-559241c6f910 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:40.613742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 110/215] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:40.619139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312247d-7d8c-475d-b306-559241c6f910 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:40.620876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc363656-77a2-412f-afaf-a226eec20423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:40.621532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc363656-77a2-412f-afaf-a226eec20423 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:40.622398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc363656-77a2-412f-afaf-a226eec20423 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:40.622797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc363656-77a2-412f-afaf-a226eec20423 None admin] PATH_INFO: `/v3/users/35f2a9450e19438980f90f601db98629` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:40.645959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc363656-77a2-412f-afaf-a226eec20423 None admin] RBAC: Authorizing `identity:get_user(user_id=35f2a9450e19438980f90f601db98629)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:40.646626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:40.647504 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc363656-77a2-412f-afaf-a226eec20423 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:40.649202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 106/216] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:40 2022] GET /identity/v3/users/35f2a9450e19438980f90f601db98629 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:40.655238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc363656-77a2-412f-afaf-a226eec20423 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:40.754732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312247d-7d8c-475d-b306-559241c6f910 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:40.780159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc363656-77a2-412f-afaf-a226eec20423 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:40.810780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59e25-18e5-4bf8-a60a-daee5538dc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:40.811526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59e25-18e5-4bf8-a60a-daee5538dc42 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:40.811802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59e25-18e5-4bf8-a60a-daee5538dc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:40.812072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59e25-18e5-4bf8-a60a-daee5538dc42 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:40.813067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a59e25-18e5-4bf8-a60a-daee5538dc42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:40.813749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:40.816277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a59e25-18e5-4bf8-a60a-daee5538dc42 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:40.825401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ecc27-af34-4689-a7a2-d5c7d2e80863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:40.826089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ecc27-af34-4689-a7a2-d5c7d2e80863 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:40.826514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ecc27-af34-4689-a7a2-d5c7d2e80863 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:40.826899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ecc27-af34-4689-a7a2-d5c7d2e80863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:40.905096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ecc27-af34-4689-a7a2-d5c7d2e80863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:40.906629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ecc27-af34-4689-a7a2-d5c7d2e80863 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:40.940651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 111/217] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:05:40 2022] POST /identity/v3/users => generated 297 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:05:41.037772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 107/218] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 05:05:41.043348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59e25-18e5-4bf8-a60a-daee5538dc42 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:41.114779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:41.154851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59e25-18e5-4bf8-a60a-daee5538dc42 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:41.190246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a96d9-cc01-49ad-8dc6-756d7a312473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:41.191046 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a96d9-cc01-49ad-8dc6-756d7a312473 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:41.191325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a96d9-cc01-49ad-8dc6-756d7a312473 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:41.191596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a96d9-cc01-49ad-8dc6-756d7a312473 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:41.192781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a96d9-cc01-49ad-8dc6-756d7a312473 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:41.194210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a96d9-cc01-49ad-8dc6-756d7a312473 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:41.195903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 112/219] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:41 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:41.202518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ecc27-af34-4689-a7a2-d5c7d2e80863 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:41.230057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:41.311119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ecc27-af34-4689-a7a2-d5c7d2e80863 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:41.350221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8d8e9-7716-48eb-ac22-c3423e23a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:41.350944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8d8e9-7716-48eb-ac22-c3423e23a235 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:41.351219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8d8e9-7716-48eb-ac22-c3423e23a235 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:41.351486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8d8e9-7716-48eb-ac22-c3423e23a235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:41.352420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8d8e9-7716-48eb-ac22-c3423e23a235 None admin] RBAC: Adding query filter params (role.id=135a36507984447394cee2c2924414bb, scope.project.id=03f4d63223db43eb85dbf6a826df6875, user.id=35f2a9450e19438980f90f601db98629) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:41.352730 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8d8e9-7716-48eb-ac22-c3423e23a235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:41.354180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8d8e9-7716-48eb-ac22-c3423e23a235 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:41.360700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 108/220] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:41 2022] GET /identity/v3/role_assignments?user.id=35f2a9450e19438980f90f601db98629&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=135a36507984447394cee2c2924414bb => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:41.754285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3121e7-8462-480d-964d-23cd191a219e None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:41.754812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3121e7-8462-480d-964d-23cd191a219e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:41.754887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3121e7-8462-480d-964d-23cd191a219e None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:41.756366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 113/221] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:41.761922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26877d-e706-4724-9f57-016f90b1b634 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:41.763009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26877d-e706-4724-9f57-016f90b1b634 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:41.763195 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26877d-e706-4724-9f57-016f90b1b634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:41.791430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ce26877d-e706-4724-9f57-016f90b1b634 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:41.792628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ce26877d-e706-4724-9f57-016f90b1b634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:41.813466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546011b-33f3-4b45-be0b-a597511c835a None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:41.814227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546011b-33f3-4b45-be0b-a597511c835a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:41.814795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546011b-33f3-4b45-be0b-a597511c835a None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:41.816599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 114/222] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:41.821860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca07e-56a9-4926-a775-4774d3fdc39b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:41.822439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca07e-56a9-4926-a775-4774d3fdc39b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:41.822922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca07e-56a9-4926-a775-4774d3fdc39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:41.853471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-fd9ca07e-56a9-4926-a775-4774d3fdc39b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:41.856418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-fd9ca07e-56a9-4926-a775-4774d3fdc39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:41.902335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 109/223] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:41.947712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26877d-e706-4724-9f57-016f90b1b634 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:41.968500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 115/224] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:41.985349 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:42.017026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca07e-56a9-4926-a775-4774d3fdc39b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:42.121136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:42.165124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26877d-e706-4724-9f57-016f90b1b634 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:42.182081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca07e-56a9-4926-a775-4774d3fdc39b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:42.222963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007fbfa-1e89-441c-a454-334f822fa63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:42.223968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007fbfa-1e89-441c-a454-334f822fa63f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:42.224465 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007fbfa-1e89-441c-a454-334f822fa63f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:42.224961 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007fbfa-1e89-441c-a454-334f822fa63f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:42.237884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007fbfa-1e89-441c-a454-334f822fa63f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-f007fbfa-1e89-441c-a454-334f822fa63f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:42.243878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:42.244757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:42.245542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:42.249198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 116/225] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:05:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:05:42.255533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007fbfa-1e89-441c-a454-334f822fa63f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:42.275154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1541860-a30a-4685-b4a1-ac5545f91ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:42.275742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1541860-a30a-4685-b4a1-ac5545f91ccf None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:42.276023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1541860-a30a-4685-b4a1-ac5545f91ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:42.276296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1541860-a30a-4685-b4a1-ac5545f91ccf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:42.309914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1541860-a30a-4685-b4a1-ac5545f91ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-e1541860-a30a-4685-b4a1-ac5545f91ccf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:42.314876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:42.315750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:42.316537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 110/226] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:05:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:05:42.324178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1541860-a30a-4685-b4a1-ac5545f91ccf None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:42.414704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007fbfa-1e89-441c-a454-334f822fa63f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:42.460973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:42.463602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:42.482329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c614f-7764-4dcc-9bf3-b2769ac5209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:42.483273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c614f-7764-4dcc-9bf3-b2769ac5209e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:42.483748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c614f-7764-4dcc-9bf3-b2769ac5209e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:42.484238 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c614f-7764-4dcc-9bf3-b2769ac5209e None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:42.485170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c614f-7764-4dcc-9bf3-b2769ac5209e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:42.485680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c614f-7764-4dcc-9bf3-b2769ac5209e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:42.487344 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c614f-7764-4dcc-9bf3-b2769ac5209e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:42.498874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 117/227] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:05:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:42.504734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1541860-a30a-4685-b4a1-ac5545f91ccf None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:42.509401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c614f-7764-4dcc-9bf3-b2769ac5209e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:42.576172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c626aa-ce12-4765-926e-6ed13650745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:42.577106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c626aa-ce12-4765-926e-6ed13650745c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:42.577609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c626aa-ce12-4765-926e-6ed13650745c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:42.578144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c626aa-ce12-4765-926e-6ed13650745c None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:42.579055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c626aa-ce12-4765-926e-6ed13650745c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:42.579596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c626aa-ce12-4765-926e-6ed13650745c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:42.581152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c626aa-ce12-4765-926e-6ed13650745c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:42.597510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 111/228] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:42.600716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c626aa-ce12-4765-926e-6ed13650745c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:42.698667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c614f-7764-4dcc-9bf3-b2769ac5209e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:42.763010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e80d77-98c7-467a-95d9-8a9c1159d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:42.764389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e80d77-98c7-467a-95d9-8a9c1159d73c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:42.764845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e80d77-98c7-467a-95d9-8a9c1159d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:42.765317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e80d77-98c7-467a-95d9-8a9c1159d73c None admin] PATH_INFO: `/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:42.766798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e80d77-98c7-467a-95d9-8a9c1159d73c None admin] RBAC: Authorizing `identity:get_user(user_id=f8c5f8b4499a41f5a0d8f0572b3750e4)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:42.769253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e80d77-98c7-467a-95d9-8a9c1159d73c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:42.771736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 118/229] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:42 2022] GET /identity/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4 => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:42.779395 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e80d77-98c7-467a-95d9-8a9c1159d73c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:42.788048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c626aa-ce12-4765-926e-6ed13650745c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:42.822478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480d230-cf78-447b-af28-eba3d32950d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:42.823236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480d230-cf78-447b-af28-eba3d32950d3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:42.823591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480d230-cf78-447b-af28-eba3d32950d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:42.823946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480d230-cf78-447b-af28-eba3d32950d3 None admin] PATH_INFO: `/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:42.826077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480d230-cf78-447b-af28-eba3d32950d3 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c5f8b4499a41f5a0d8f0572b3750e4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:42.827809 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480d230-cf78-447b-af28-eba3d32950d3 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:42.829717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 112/230] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:42 2022] GET /identity/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4 => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:42.835038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480d230-cf78-447b-af28-eba3d32950d3 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:42.847122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:42.902361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:42.947452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480d230-cf78-447b-af28-eba3d32950d3 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:42.985969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9e476-5b5e-404a-aa1e-a0983953cd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:42.987031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9e476-5b5e-404a-aa1e-a0983953cd8f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:42.987294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e80d77-98c7-467a-95d9-8a9c1159d73c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:42.987728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9e476-5b5e-404a-aa1e-a0983953cd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:42.988231 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9e476-5b5e-404a-aa1e-a0983953cd8f None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:42.989716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9e476-5b5e-404a-aa1e-a0983953cd8f None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:42.991570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9e476-5b5e-404a-aa1e-a0983953cd8f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:42.993461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 113/231] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:42 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:43.001240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9e476-5b5e-404a-aa1e-a0983953cd8f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:43.075074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df9967-97d9-46d5-bc0f-f563a363f091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:43.075729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df9967-97d9-46d5-bc0f-f563a363f091 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:43.076033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df9967-97d9-46d5-bc0f-f563a363f091 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:43.076332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df9967-97d9-46d5-bc0f-f563a363f091 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:43.077509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df9967-97d9-46d5-bc0f-f563a363f091 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:43.079063 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df9967-97d9-46d5-bc0f-f563a363f091 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:43.080842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 119/232] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:42 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:43.095666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:43.100545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df9967-97d9-46d5-bc0f-f563a363f091 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:43.124193 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9e476-5b5e-404a-aa1e-a0983953cd8f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:43.171553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e0be6-4b82-4d46-a300-8af9d7662adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:43.172983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e0be6-4b82-4d46-a300-8af9d7662adb None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:43.173467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e0be6-4b82-4d46-a300-8af9d7662adb None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:43.173941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e0be6-4b82-4d46-a300-8af9d7662adb None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875/users/f8c5f8b4499a41f5a0d8f0572b3750e4/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:43.176214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e0be6-4b82-4d46-a300-8af9d7662adb None admin] RBAC: Authorizing `identity:create_grant(project_id=03f4d63223db43eb85dbf6a826df6875, user_id=f8c5f8b4499a41f5a0d8f0572b3750e4, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:43.177938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e0be6-4b82-4d46-a300-8af9d7662adb None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:43.255161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 114/233] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:05:43 2022] PUT /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875/users/f8c5f8b4499a41f5a0d8f0572b3750e4/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:05:43.274571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df9967-97d9-46d5-bc0f-f563a363f091 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:43.314678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:43.340963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6c4ce-905f-45eb-a945-4344e3f2f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:43.341556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6c4ce-905f-45eb-a945-4344e3f2f716 None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:43.341833 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6c4ce-905f-45eb-a945-4344e3f2f716 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:43.342108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6c4ce-905f-45eb-a945-4344e3f2f716 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875/users/f8c5f8b4499a41f5a0d8f0572b3750e4/roles/ac5a79a4ca8d49298d455da9928e5a4f` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:43.347925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6c4ce-905f-45eb-a945-4344e3f2f716 None admin] RBAC: Authorizing `identity:create_grant(project_id=03f4d63223db43eb85dbf6a826df6875, user_id=f8c5f8b4499a41f5a0d8f0572b3750e4, role_id=ac5a79a4ca8d49298d455da9928e5a4f)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:43.349441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6c4ce-905f-45eb-a945-4344e3f2f716 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:43.461118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 120/234] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:05:43 2022] PUT /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875/users/f8c5f8b4499a41f5a0d8f0572b3750e4/roles/ac5a79a4ca8d49298d455da9928e5a4f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:05:43.591584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8c374-e687-4fe1-a101-32ff9de44a6a None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:43.592237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8c374-e687-4fe1-a101-32ff9de44a6a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:43.592735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8c374-e687-4fe1-a101-32ff9de44a6a None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:43.594340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 115/235] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:43.600100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd97172-a6b1-4228-8f92-92390aecc545 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:43.600396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd97172-a6b1-4228-8f92-92390aecc545 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:43.600818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd97172-a6b1-4228-8f92-92390aecc545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:43.627487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-4cd97172-a6b1-4228-8f92-92390aecc545 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:43.628855 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4cd97172-a6b1-4228-8f92-92390aecc545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:43.705203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c2d87-0b26-4244-9e5d-be1ef4a6c984 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:43.705203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c2d87-0b26-4244-9e5d-be1ef4a6c984 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:43.705203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c2d87-0b26-4244-9e5d-be1ef4a6c984 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:43.707039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 116/236] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:43.712892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626f6a2-bddc-48c0-b009-6c188db74ab1 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:43.713485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626f6a2-bddc-48c0-b009-6c188db74ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:43.713957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626f6a2-bddc-48c0-b009-6c188db74ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:43.716710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 121/237] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:43.747609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-3626f6a2-bddc-48c0-b009-6c188db74ab1 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:43.749186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3626f6a2-bddc-48c0-b009-6c188db74ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:43.763205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd97172-a6b1-4228-8f92-92390aecc545 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:43.837781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 117/238] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:43.839099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048e7ff-033c-4e92-8b7d-ae680ff72f66 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:43.839379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048e7ff-033c-4e92-8b7d-ae680ff72f66 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:43.839650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048e7ff-033c-4e92-8b7d-ae680ff72f66 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:43.848018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 118/239] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:43.859863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb0f9-478a-46ae-8ad0-f2e5611d9eb3 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:43.860134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb0f9-478a-46ae-8ad0-f2e5611d9eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:43.860410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb0f9-478a-46ae-8ad0-f2e5611d9eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:43.880939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-6b8eb0f9-478a-46ae-8ad0-f2e5611d9eb3 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:43.882131 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6b8eb0f9-478a-46ae-8ad0-f2e5611d9eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:43.909523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd97172-a6b1-4228-8f92-92390aecc545 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:43.921299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:43.946290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59fa3-bfc7-449f-9f8b-490635d767c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:43.946959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59fa3-bfc7-449f-9f8b-490635d767c3 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:43.947277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59fa3-bfc7-449f-9f8b-490635d767c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:43.947551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59fa3-bfc7-449f-9f8b-490635d767c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:43.959949 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b59fa3-bfc7-449f-9f8b-490635d767c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-18b59fa3-bfc7-449f-9f8b-490635d767c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:43.965156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:43.968584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 122/240] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:43.969588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59fa3-bfc7-449f-9f8b-490635d767c3 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:43.971889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:43.982182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 119/241] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:43.983733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eb0f9-478a-46ae-8ad0-f2e5611d9eb3 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:44.084176 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59fa3-bfc7-449f-9f8b-490635d767c3 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:44.132922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eb0f9-478a-46ae-8ad0-f2e5611d9eb3 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:44.134865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18ddc4-e8da-4b15-b13e-4e0bfc014df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:44.135500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18ddc4-e8da-4b15-b13e-4e0bfc014df7 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:44.135775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18ddc4-e8da-4b15-b13e-4e0bfc014df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:44.136044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18ddc4-e8da-4b15-b13e-4e0bfc014df7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:44.137190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18ddc4-e8da-4b15-b13e-4e0bfc014df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:44.139218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18ddc4-e8da-4b15-b13e-4e0bfc014df7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:44.140794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 123/242] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:44.141552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18ddc4-e8da-4b15-b13e-4e0bfc014df7 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:44.187204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba71b37-74a6-4715-91d7-40bc7e226970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:44.187882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba71b37-74a6-4715-91d7-40bc7e226970 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:44.188208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba71b37-74a6-4715-91d7-40bc7e226970 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:44.188488 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba71b37-74a6-4715-91d7-40bc7e226970 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:44.189204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba71b37-74a6-4715-91d7-40bc7e226970 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:44.189506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba71b37-74a6-4715-91d7-40bc7e226970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:44.190983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba71b37-74a6-4715-91d7-40bc7e226970 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:44.200928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 120/243] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:44.201808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba71b37-74a6-4715-91d7-40bc7e226970 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:44.206580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:44.265035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:44.294911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18ddc4-e8da-4b15-b13e-4e0bfc014df7 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:44.309730 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba71b37-74a6-4715-91d7-40bc7e226970 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:44.345260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c4e77-f4fd-4602-81f7-8002c39aa790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:44.345927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c4e77-f4fd-4602-81f7-8002c39aa790 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:44.346210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c4e77-f4fd-4602-81f7-8002c39aa790 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:44.346524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c4e77-f4fd-4602-81f7-8002c39aa790 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:44.347256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c4e77-f4fd-4602-81f7-8002c39aa790 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:44.347736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08abcdf-b9a4-4f8b-b70d-d06d06bffa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:44.348603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08abcdf-b9a4-4f8b-b70d-d06d06bffa18 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:44.348708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c4e77-f4fd-4602-81f7-8002c39aa790 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:44.349187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08abcdf-b9a4-4f8b-b70d-d06d06bffa18 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:44.349658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08abcdf-b9a4-4f8b-b70d-d06d06bffa18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:44.363231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08abcdf-b9a4-4f8b-b70d-d06d06bffa18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-c08abcdf-b9a4-4f8b-b70d-d06d06bffa18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:44.368169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:44.371423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 124/244] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:44.372785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08abcdf-b9a4-4f8b-b70d-d06d06bffa18 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:44.430650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 121/245] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:05:44 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:44.431491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c4e77-f4fd-4602-81f7-8002c39aa790 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:44.493565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:44.500178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08abcdf-b9a4-4f8b-b70d-d06d06bffa18 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:44.546096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa9699-454f-4c2b-b482-21904fee5866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:44.548931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa9699-454f-4c2b-b482-21904fee5866 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:44.549480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa9699-454f-4c2b-b482-21904fee5866 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:44.549958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa9699-454f-4c2b-b482-21904fee5866 None admin] PATH_INFO: `/v3/users/25e14363a1934a53a5be260e7d09a981` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:44.568763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa9699-454f-4c2b-b482-21904fee5866 None admin] RBAC: Authorizing `identity:get_user(user_id=25e14363a1934a53a5be260e7d09a981)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:44.570680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa9699-454f-4c2b-b482-21904fee5866 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:44.573485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 125/246] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:44 2022] GET /identity/v3/users/25e14363a1934a53a5be260e7d09a981 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:44.579807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa9699-454f-4c2b-b482-21904fee5866 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:44.667996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c4e77-f4fd-4602-81f7-8002c39aa790 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:44.691245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:44.722746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4fd8-98eb-497a-919c-b17d6052e8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:44.723898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4fd8-98eb-497a-919c-b17d6052e8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:44.724388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4fd8-98eb-497a-919c-b17d6052e8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:44.724886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4fd8-98eb-497a-919c-b17d6052e8e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:44.725834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b4fd8-98eb-497a-919c-b17d6052e8e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:44.726408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b4fd8-98eb-497a-919c-b17d6052e8e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:44.732142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b4fd8-98eb-497a-919c-b17d6052e8e9 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:44.744934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 122/247] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:44.750768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4fd8-98eb-497a-919c-b17d6052e8e9 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:44.772981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa9699-454f-4c2b-b482-21904fee5866 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:44.824585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee9252-740a-477f-90b3-dfa3e530bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:44.825790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee9252-740a-477f-90b3-dfa3e530bb06 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:44.826078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee9252-740a-477f-90b3-dfa3e530bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:44.826399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee9252-740a-477f-90b3-dfa3e530bb06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:44.864010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:44.905118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4fd8-98eb-497a-919c-b17d6052e8e9 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:44.925039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee9252-740a-477f-90b3-dfa3e530bb06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:44.926685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee9252-740a-477f-90b3-dfa3e530bb06 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:44.954614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb900a-629e-4ae4-ae53-906c6cf57673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:44.955478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb900a-629e-4ae4-ae53-906c6cf57673 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:44.955922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb900a-629e-4ae4-ae53-906c6cf57673 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:44.956754 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb900a-629e-4ae4-ae53-906c6cf57673 None admin] PATH_INFO: `/v3/users/35f2a9450e19438980f90f601db98629` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:44.958631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb900a-629e-4ae4-ae53-906c6cf57673 None admin] RBAC: Authorizing `identity:get_user(user_id=35f2a9450e19438980f90f601db98629)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:44.960904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb900a-629e-4ae4-ae53-906c6cf57673 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:44.963833 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 123/248] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:44 2022] GET /identity/v3/users/35f2a9450e19438980f90f601db98629 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:44.969655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb900a-629e-4ae4-ae53-906c6cf57673 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:45.036982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:45.056276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 126/249] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:45.062569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee9252-740a-477f-90b3-dfa3e530bb06 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:45.108589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb900a-629e-4ae4-ae53-906c6cf57673 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:45.136452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:45.155587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b1fc1-2b8c-46cb-a8da-2c5bd58c3cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:45.156246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b1fc1-2b8c-46cb-a8da-2c5bd58c3cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:45.156611 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b1fc1-2b8c-46cb-a8da-2c5bd58c3cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:45.163043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b1fc1-2b8c-46cb-a8da-2c5bd58c3cf4 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:45.165547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b1fc1-2b8c-46cb-a8da-2c5bd58c3cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:45.168089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b1fc1-2b8c-46cb-a8da-2c5bd58c3cf4 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:45.170970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 124/250] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:44 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:45.179788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b1fc1-2b8c-46cb-a8da-2c5bd58c3cf4 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:45.202667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee9252-740a-477f-90b3-dfa3e530bb06 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:45.271138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9168d-81e5-45d0-87f2-cf8cb999d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:45.271723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9168d-81e5-45d0-87f2-cf8cb999d996 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:45.271995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9168d-81e5-45d0-87f2-cf8cb999d996 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:45.272271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9168d-81e5-45d0-87f2-cf8cb999d996 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:45.273997 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9168d-81e5-45d0-87f2-cf8cb999d996 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:45.275934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9168d-81e5-45d0-87f2-cf8cb999d996 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:45.288067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 127/251] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:45 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:45.299573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9168d-81e5-45d0-87f2-cf8cb999d996 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:45.412042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b1fc1-2b8c-46cb-a8da-2c5bd58c3cf4 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:45.442086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:45.524157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ee3c6-3c5f-4ca4-a4c3-4ffb4af2cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:45.524796 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ee3c6-3c5f-4ca4-a4c3-4ffb4af2cc24 None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:45.525072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ee3c6-3c5f-4ca4-a4c3-4ffb4af2cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:45.525391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ee3c6-3c5f-4ca4-a4c3-4ffb4af2cc24 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875/users/35f2a9450e19438980f90f601db98629/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:45.529215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ee3c6-3c5f-4ca4-a4c3-4ffb4af2cc24 None admin] RBAC: Authorizing `identity:create_grant(project_id=03f4d63223db43eb85dbf6a826df6875, user_id=35f2a9450e19438980f90f601db98629, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:45.530686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ee3c6-3c5f-4ca4-a4c3-4ffb4af2cc24 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:45.588727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9168d-81e5-45d0-87f2-cf8cb999d996 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:45.627125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:45.644395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 125/252] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:05:45 2022] PUT /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875/users/35f2a9450e19438980f90f601db98629/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:05:45.652270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc524662-16a5-43f7-8463-90592dc13081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:45.652939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc524662-16a5-43f7-8463-90592dc13081 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:45.653348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc524662-16a5-43f7-8463-90592dc13081 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:45.653605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc524662-16a5-43f7-8463-90592dc13081 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:45.654433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc524662-16a5-43f7-8463-90592dc13081 None admin] RBAC: Adding query filter params (role.id=99363062b2b644ee970fba81eb1e5f45, scope.project.id=03f4d63223db43eb85dbf6a826df6875, user.id=25e14363a1934a53a5be260e7d09a981) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:45.654744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc524662-16a5-43f7-8463-90592dc13081 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:45.656219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc524662-16a5-43f7-8463-90592dc13081 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:45.668981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 128/253] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:45 2022] GET /identity/v3/role_assignments?user.id=25e14363a1934a53a5be260e7d09a981&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=99363062b2b644ee970fba81eb1e5f45 => generated 259 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:45.775103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94bd1-43d2-455e-8d95-580301efc681 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:45.775418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94bd1-43d2-455e-8d95-580301efc681 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:45.775579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94bd1-43d2-455e-8d95-580301efc681 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:45.777257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 126/254] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:45.783353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ec565-c7da-4ece-aae4-c3039b476f9b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:45.783869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ec565-c7da-4ece-aae4-c3039b476f9b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:45.784070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ec565-c7da-4ece-aae4-c3039b476f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:45.806451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a07ec565-c7da-4ece-aae4-c3039b476f9b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:45.807644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a07ec565-c7da-4ece-aae4-c3039b476f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:45.884267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 129/255] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:45.896518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f9fec-0582-4bd8-97f8-ed913ffe511a None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:45.896859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f9fec-0582-4bd8-97f8-ed913ffe511a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:45.897080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f9fec-0582-4bd8-97f8-ed913ffe511a None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:45.898516 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 127/256] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:45.906951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9f6c5-e1b1-4ff3-9eaa-bf22c24735ff None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:45.907270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9f6c5-e1b1-4ff3-9eaa-bf22c24735ff None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:45.907728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9f6c5-e1b1-4ff3-9eaa-bf22c24735ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:45.928087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c0c9f6c5-e1b1-4ff3-9eaa-bf22c24735ff None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:45.929011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f9fec-0582-4bd8-97f8-ed913ffe511a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:45.940285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c0c9f6c5-e1b1-4ff3-9eaa-bf22c24735ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:46.046281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 130/257] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:46.079445 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9f6c5-e1b1-4ff3-9eaa-bf22c24735ff None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:46.220370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:46.227042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f9fec-0582-4bd8-97f8-ed913ffe511a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:46.283121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9f6c5-e1b1-4ff3-9eaa-bf22c24735ff None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:46.321016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c828-644c-40a5-9a51-ae5c41e05901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:46.321572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c828-644c-40a5-9a51-ae5c41e05901 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:46.321843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c828-644c-40a5-9a51-ae5c41e05901 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:46.322114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c828-644c-40a5-9a51-ae5c41e05901 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:46.331060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48e6c0-9fd0-404e-bafe-7d62c5cb6d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:46.331997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48e6c0-9fd0-404e-bafe-7d62c5cb6d78 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:46.332468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48e6c0-9fd0-404e-bafe-7d62c5cb6d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:46.332933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48e6c0-9fd0-404e-bafe-7d62c5cb6d78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:46.333053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2c828-644c-40a5-9a51-ae5c41e05901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3ca2c828-644c-40a5-9a51-ae5c41e05901 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:46.338299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:46.339226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:46.340492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 131/258] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:05:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:05:46.345740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c828-644c-40a5-9a51-ae5c41e05901 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:46.354662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48e6c0-9fd0-404e-bafe-7d62c5cb6d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-1c48e6c0-9fd0-404e-bafe-7d62c5cb6d78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:46.361260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:46.362117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:05:46.362952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:46.374832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 128/259] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:05:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:46.376097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48e6c0-9fd0-404e-bafe-7d62c5cb6d78 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:46.433673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:46.458334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c828-644c-40a5-9a51-ae5c41e05901 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:46.467882 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:46.493574 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea1c0-968a-4d0c-a1cd-a0d94779f1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:46.494190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea1c0-968a-4d0c-a1cd-a0d94779f1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:46.494496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea1c0-968a-4d0c-a1cd-a0d94779f1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:46.494765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea1c0-968a-4d0c-a1cd-a0d94779f1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:46.495482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea1c0-968a-4d0c-a1cd-a0d94779f1f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:46.495784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea1c0-968a-4d0c-a1cd-a0d94779f1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:46.497392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea1c0-968a-4d0c-a1cd-a0d94779f1f7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:46.507359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 132/260] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:05:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:46.513181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea1c0-968a-4d0c-a1cd-a0d94779f1f7 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:46.604870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48e6c0-9fd0-404e-bafe-7d62c5cb6d78 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:46.625526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea1c0-968a-4d0c-a1cd-a0d94779f1f7 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:46.670641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bbc74-f398-4a04-94aa-a1d39f846188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:46.671295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bbc74-f398-4a04-94aa-a1d39f846188 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:46.671564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bbc74-f398-4a04-94aa-a1d39f846188 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:46.672336 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bbc74-f398-4a04-94aa-a1d39f846188 None admin] PATH_INFO: `/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:46.673514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bbc74-f398-4a04-94aa-a1d39f846188 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c5f8b4499a41f5a0d8f0572b3750e4)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:46.675475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bbc74-f398-4a04-94aa-a1d39f846188 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:46.677554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 133/261] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:46 2022] GET /identity/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:46.683010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bbc74-f398-4a04-94aa-a1d39f846188 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:46.703694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3e681-9f2b-4cde-aa51-6c1daff73c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:46.704336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3e681-9f2b-4cde-aa51-6c1daff73c8a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:46.710256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3e681-9f2b-4cde-aa51-6c1daff73c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:46.710256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3e681-9f2b-4cde-aa51-6c1daff73c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:46.710256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3e681-9f2b-4cde-aa51-6c1daff73c8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:46.710256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3e681-9f2b-4cde-aa51-6c1daff73c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:46.710256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3e681-9f2b-4cde-aa51-6c1daff73c8a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:46.725531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 129/262] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:46.728348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:46.732422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3e681-9f2b-4cde-aa51-6c1daff73c8a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:46.798929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bbc74-f398-4a04-94aa-a1d39f846188 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:46.837002 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e27b-ab95-49c6-b20d-c5f06c704dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:46.837613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e27b-ab95-49c6-b20d-c5f06c704dcf None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:46.837888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e27b-ab95-49c6-b20d-c5f06c704dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:46.838155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e27b-ab95-49c6-b20d-c5f06c704dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:46.912794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071e27b-ab95-49c6-b20d-c5f06c704dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:46.914257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071e27b-ab95-49c6-b20d-c5f06c704dcf None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:46.943967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:46.957303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:46.959591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3e681-9f2b-4cde-aa51-6c1daff73c8a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:47.033412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 134/263] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 05:05:47.038763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e27b-ab95-49c6-b20d-c5f06c704dcf None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:47.046549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf790e-f1b1-41c8-992d-eb68c30f9609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:47.047564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf790e-f1b1-41c8-992d-eb68c30f9609 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:47.047842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf790e-f1b1-41c8-992d-eb68c30f9609 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:47.048115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf790e-f1b1-41c8-992d-eb68c30f9609 None admin] PATH_INFO: `/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:47.049301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf790e-f1b1-41c8-992d-eb68c30f9609 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c5f8b4499a41f5a0d8f0572b3750e4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:47.059026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf790e-f1b1-41c8-992d-eb68c30f9609 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:47.061185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 130/264] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:46 2022] GET /identity/v3/users/f8c5f8b4499a41f5a0d8f0572b3750e4 => generated 283 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:47.066841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf790e-f1b1-41c8-992d-eb68c30f9609 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:47.213019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e27b-ab95-49c6-b20d-c5f06c704dcf None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:47.288542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176f40-82c2-49f1-9e89-400e1a69c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:47.289177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176f40-82c2-49f1-9e89-400e1a69c01a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:47.289456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176f40-82c2-49f1-9e89-400e1a69c01a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:47.289728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176f40-82c2-49f1-9e89-400e1a69c01a None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:47.295570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a176f40-82c2-49f1-9e89-400e1a69c01a None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:47.297557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a176f40-82c2-49f1-9e89-400e1a69c01a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:47.300572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 135/265] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:47 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:47.307943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176f40-82c2-49f1-9e89-400e1a69c01a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:47.316517 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf790e-f1b1-41c8-992d-eb68c30f9609 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:47.324111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:47.378010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88af3f-efac-470e-886a-c66297844e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:47.378731 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88af3f-efac-470e-886a-c66297844e70 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:47.379006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88af3f-efac-470e-886a-c66297844e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:47.380140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88af3f-efac-470e-886a-c66297844e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:47.431922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:47.463568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176f40-82c2-49f1-9e89-400e1a69c01a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:47.501292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a673a-4290-4627-b368-9a87c867b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:47.501535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88af3f-efac-470e-886a-c66297844e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:47.502274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a673a-4290-4627-b368-9a87c867b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:47.502715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a673a-4290-4627-b368-9a87c867b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:47.502941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88af3f-efac-470e-886a-c66297844e70 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:47.503276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a673a-4290-4627-b368-9a87c867b0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:47.504222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a673a-4290-4627-b368-9a87c867b0b3 None admin] RBAC: Adding query filter params (role.id=ac5a79a4ca8d49298d455da9928e5a4f, scope.project.id=03f4d63223db43eb85dbf6a826df6875, user.id=f8c5f8b4499a41f5a0d8f0572b3750e4) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:47.504705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a673a-4290-4627-b368-9a87c867b0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:47.506346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a673a-4290-4627-b368-9a87c867b0b3 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:47.513420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 136/266] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:47 2022] GET /identity/v3/role_assignments?user.id=f8c5f8b4499a41f5a0d8f0572b3750e4&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=ac5a79a4ca8d49298d455da9928e5a4f => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:47.620424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 131/267] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 05:05:47.626902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a673a-4290-4627-b368-9a87c867b0b3 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:47.742865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:47.773579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a673a-4290-4627-b368-9a87c867b0b3 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:47.810493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8304ce6-fc0a-42ac-8d64-51aaed174a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:47.811865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304ce6-fc0a-42ac-8d64-51aaed174a83 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:47.812309 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304ce6-fc0a-42ac-8d64-51aaed174a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:47.812733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304ce6-fc0a-42ac-8d64-51aaed174a83 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:47.814076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8304ce6-fc0a-42ac-8d64-51aaed174a83 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:47.815684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8304ce6-fc0a-42ac-8d64-51aaed174a83 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:47.817523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 137/268] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:47 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:47.827456 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88af3f-efac-470e-886a-c66297844e70 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:47.911372 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:47.958590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88af3f-efac-470e-886a-c66297844e70 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:48.004612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd0c2b-6e4f-441d-85e2-5ba05129f6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:48.005447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd0c2b-6e4f-441d-85e2-5ba05129f6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.005865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd0c2b-6e4f-441d-85e2-5ba05129f6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.006294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd0c2b-6e4f-441d-85e2-5ba05129f6b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.007241 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd0c2b-6e4f-441d-85e2-5ba05129f6b7 None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=03f4d63223db43eb85dbf6a826df6875, user.id=f8c5f8b4499a41f5a0d8f0572b3750e4) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:48.007690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd0c2b-6e4f-441d-85e2-5ba05129f6b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:48.009264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd0c2b-6e4f-441d-85e2-5ba05129f6b7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:48.015851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 132/269] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:47 2022] GET /identity/v3/role_assignments?user.id=f8c5f8b4499a41f5a0d8f0572b3750e4&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:48.102073 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf8d4-8495-4930-94e0-a4d919a12825 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.102625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf8d4-8495-4930-94e0-a4d919a12825 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.103053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf8d4-8495-4930-94e0-a4d919a12825 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.104881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 138/270] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:48.112171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746750db-adba-4c2f-a1fa-d42ee0cc7974 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.112695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746750db-adba-4c2f-a1fa-d42ee0cc7974 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.113111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746750db-adba-4c2f-a1fa-d42ee0cc7974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.140370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-746750db-adba-4c2f-a1fa-d42ee0cc7974 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:48.142077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-746750db-adba-4c2f-a1fa-d42ee0cc7974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:48.234344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 133/271] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:48.280724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf8d4-8495-4930-94e0-a4d919a12825 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:48.392806 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf8d4-8495-4930-94e0-a4d919a12825 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:48.428622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aae582-ef48-49ac-a6ed-76ca068e165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:48.429266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aae582-ef48-49ac-a6ed-76ca068e165c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.429542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aae582-ef48-49ac-a6ed-76ca068e165c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.429869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aae582-ef48-49ac-a6ed-76ca068e165c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.431040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aae582-ef48-49ac-a6ed-76ca068e165c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:48.432469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aae582-ef48-49ac-a6ed-76ca068e165c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:48.434916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 139/272] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:48.440696 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746750db-adba-4c2f-a1fa-d42ee0cc7974 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:48.499706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:48.554693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746750db-adba-4c2f-a1fa-d42ee0cc7974 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:48.575484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d5265-6277-4b66-88da-2464466855a0 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.575923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d5265-6277-4b66-88da-2464466855a0 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.576201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d5265-6277-4b66-88da-2464466855a0 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.577828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 140/273] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:05:48.587532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5afdd-f819-4712-a4b9-8ec0b2e9dda2 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.588285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5afdd-f819-4712-a4b9-8ec0b2e9dda2 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.588807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5afdd-f819-4712-a4b9-8ec0b2e9dda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.598143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7632f2-62db-404d-9833-6664c57c41ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:48.598789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7632f2-62db-404d-9833-6664c57c41ee None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.599060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7632f2-62db-404d-9833-6664c57c41ee None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.599326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7632f2-62db-404d-9833-6664c57c41ee None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.600019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7632f2-62db-404d-9833-6664c57c41ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:48.601458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7632f2-62db-404d-9833-6664c57c41ee None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:48.606648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:48.612615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-d5e5afdd-f819-4712-a4b9-8ec0b2e9dda2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:48.613873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d5e5afdd-f819-4712-a4b9-8ec0b2e9dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:48.701084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 141/274] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:48.720129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 134/275] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:05:48 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:05:48.726981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869ed51-eaa8-4ef5-bf66-8dab6d9ec6b1 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.727339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869ed51-eaa8-4ef5-bf66-8dab6d9ec6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.727539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869ed51-eaa8-4ef5-bf66-8dab6d9ec6b1 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.728389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7632f2-62db-404d-9833-6664c57c41ee None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:48.729274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 142/276] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:48.737082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879393-0d15-4df0-b133-f5447d643a5d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.737398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879393-0d15-4df0-b133-f5447d643a5d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.737681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879393-0d15-4df0-b133-f5447d643a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.760303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-84879393-0d15-4df0-b133-f5447d643a5d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:48.761577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-84879393-0d15-4df0-b133-f5447d643a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:48.846834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 143/277] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:48.848539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafe8aa-cdea-48b3-bb57-7150874aa1dd None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.848820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafe8aa-cdea-48b3-bb57-7150874aa1dd None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.849091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafe8aa-cdea-48b3-bb57-7150874aa1dd None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.851419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 144/278] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:48.858084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894123-2c93-4208-83f4-d047fe5e475f None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.858458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894123-2c93-4208-83f4-d047fe5e475f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.858791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894123-2c93-4208-83f4-d047fe5e475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.859111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7632f2-62db-404d-9833-6664c57c41ee None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:48.876202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:48.883318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b1894123-2c93-4208-83f4-d047fe5e475f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:48.884877 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b1894123-2c93-4208-83f4-d047fe5e475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:48.901977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb838d-0e7d-42c9-8c1b-ecc7480f052b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:48.902650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb838d-0e7d-42c9-8c1b-ecc7480f052b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:48.903442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb838d-0e7d-42c9-8c1b-ecc7480f052b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:48.903702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb838d-0e7d-42c9-8c1b-ecc7480f052b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:48.914628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb838d-0e7d-42c9-8c1b-ecc7480f052b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-7ccb838d-0e7d-42c9-8c1b-ecc7480f052b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:48.920304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:48.921403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:48.923030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 135/279] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:05:48.923811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb838d-0e7d-42c9-8c1b-ecc7480f052b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:48.962603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:48.970782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 145/280] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:48.972036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1894123-2c93-4208-83f4-d047fe5e475f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.052752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb838d-0e7d-42c9-8c1b-ecc7480f052b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:49.098802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c2103-99bd-4ea4-b7b4-027ca844852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:49.099935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2103-99bd-4ea4-b7b4-027ca844852b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:49.100380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2103-99bd-4ea4-b7b4-027ca844852b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:49.101055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2103-99bd-4ea4-b7b4-027ca844852b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:49.104534 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1894123-2c93-4208-83f4-d047fe5e475f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:49.115061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c2103-99bd-4ea4-b7b4-027ca844852b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-762c2103-99bd-4ea4-b7b4-027ca844852b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:49.123053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:49.124146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:49.125137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:49.127774 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 136/281] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:49.128697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c2103-99bd-4ea4-b7b4-027ca844852b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.150774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0668-46d4-47af-9251-9ba08a103d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:49.151794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0668-46d4-47af-9251-9ba08a103d70 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:49.152329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0668-46d4-47af-9251-9ba08a103d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:49.152745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0668-46d4-47af-9251-9ba08a103d70 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:49.154160 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d0668-46d4-47af-9251-9ba08a103d70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:49.154634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d0668-46d4-47af-9251-9ba08a103d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:49.156268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d0668-46d4-47af-9251-9ba08a103d70 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:49.167188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:49.176821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 146/282] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:49.181668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0668-46d4-47af-9251-9ba08a103d70 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.242649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:49.258439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c2103-99bd-4ea4-b7b4-027ca844852b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:49.288447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0668-46d4-47af-9251-9ba08a103d70 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:49.306254 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904bca0-02c8-485f-aac7-be75e2ee5411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:49.307480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904bca0-02c8-485f-aac7-be75e2ee5411 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:49.308265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904bca0-02c8-485f-aac7-be75e2ee5411 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:49.308718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904bca0-02c8-485f-aac7-be75e2ee5411 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:49.323860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904bca0-02c8-485f-aac7-be75e2ee5411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-d904bca0-02c8-485f-aac7-be75e2ee5411 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:49.328807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:49.329699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:49.330523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 137/283] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:49.334132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77645ba9-f919-46cd-a479-23f24ff9fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:49.335362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645ba9-f919-46cd-a479-23f24ff9fe81 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:49.335699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904bca0-02c8-485f-aac7-be75e2ee5411 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.335937 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645ba9-f919-46cd-a479-23f24ff9fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:49.336349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645ba9-f919-46cd-a479-23f24ff9fe81 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:49.337308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77645ba9-f919-46cd-a479-23f24ff9fe81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:49.337772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77645ba9-f919-46cd-a479-23f24ff9fe81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:49.340910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77645ba9-f919-46cd-a479-23f24ff9fe81 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:49.352763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 147/284] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:49.354512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77645ba9-f919-46cd-a479-23f24ff9fe81 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.455919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904bca0-02c8-485f-aac7-be75e2ee5411 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:49.482572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:49.492736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77645ba9-f919-46cd-a479-23f24ff9fe81 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:49.495304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c88125-1651-445d-bc5b-35c1232949f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:49.497040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88125-1651-445d-bc5b-35c1232949f3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:49.497434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88125-1651-445d-bc5b-35c1232949f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:49.497816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88125-1651-445d-bc5b-35c1232949f3 None admin] PATH_INFO: `/v3/users/25e14363a1934a53a5be260e7d09a981` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:49.499172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c88125-1651-445d-bc5b-35c1232949f3 None admin] RBAC: Authorizing `identity:get_user(user_id=25e14363a1934a53a5be260e7d09a981)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:49.500742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c88125-1651-445d-bc5b-35c1232949f3 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:49.506386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 138/285] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:49 2022] GET /identity/v3/users/25e14363a1934a53a5be260e7d09a981 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:49.507347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c88125-1651-445d-bc5b-35c1232949f3 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.521609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:49.539968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3028e67-15da-457a-94bb-2dd834a18d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:49.540949 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3028e67-15da-457a-94bb-2dd834a18d8d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:49.541425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3028e67-15da-457a-94bb-2dd834a18d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:49.541913 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3028e67-15da-457a-94bb-2dd834a18d8d None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:49.542855 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3028e67-15da-457a-94bb-2dd834a18d8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:49.543396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3028e67-15da-457a-94bb-2dd834a18d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:49.545789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3028e67-15da-457a-94bb-2dd834a18d8d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:49.556384 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 148/286] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:49.557191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3028e67-15da-457a-94bb-2dd834a18d8d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.629741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c88125-1651-445d-bc5b-35c1232949f3 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:49.666929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4ef6f-cfd4-4812-9a27-953a242a4597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:49.667929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4ef6f-cfd4-4812-9a27-953a242a4597 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:49.668439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4ef6f-cfd4-4812-9a27-953a242a4597 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:49.668953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4ef6f-cfd4-4812-9a27-953a242a4597 None admin] PATH_INFO: `/v3/users/2b4ef5d6d71e41128ebbc24c3b79ddd6` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:49.683784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4ef6f-cfd4-4812-9a27-953a242a4597 None admin] RBAC: Authorizing `identity:get_user(user_id=2b4ef5d6d71e41128ebbc24c3b79ddd6)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:49.686121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4ef6f-cfd4-4812-9a27-953a242a4597 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:49.688372 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 139/287] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:49 2022] GET /identity/v3/users/2b4ef5d6d71e41128ebbc24c3b79ddd6 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:49.689343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4ef6f-cfd4-4812-9a27-953a242a4597 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.710438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:49.714221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3028e67-15da-457a-94bb-2dd834a18d8d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:49.773515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b3642-d394-4341-bd5e-d82bdd216f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:49.774146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3642-d394-4341-bd5e-d82bdd216f87 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:49.774444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3642-d394-4341-bd5e-d82bdd216f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:49.774715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b3642-d394-4341-bd5e-d82bdd216f87 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:49.775867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b3642-d394-4341-bd5e-d82bdd216f87 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:49.777315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b3642-d394-4341-bd5e-d82bdd216f87 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:49.779408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 149/288] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:49 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:49.780276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b3642-d394-4341-bd5e-d82bdd216f87 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.799747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4ef6f-cfd4-4812-9a27-953a242a4597 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:49.835287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:49.837385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da202f37-7956-4c76-b190-bc3731d42e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:49.838466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da202f37-7956-4c76-b190-bc3731d42e20 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:49.838946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da202f37-7956-4c76-b190-bc3731d42e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:49.839416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da202f37-7956-4c76-b190-bc3731d42e20 None admin] PATH_INFO: `/v3/users/35f2a9450e19438980f90f601db98629` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:49.841090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da202f37-7956-4c76-b190-bc3731d42e20 None admin] RBAC: Authorizing `identity:get_user(user_id=35f2a9450e19438980f90f601db98629)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:49.842800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da202f37-7956-4c76-b190-bc3731d42e20 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:49.844782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 140/289] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:49 2022] GET /identity/v3/users/35f2a9450e19438980f90f601db98629 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:49.845671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da202f37-7956-4c76-b190-bc3731d42e20 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.895468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b3642-d394-4341-bd5e-d82bdd216f87 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:49.932319 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d736e-f83b-4929-8c9c-a5905ac0b0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:49.932956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d736e-f83b-4929-8c9c-a5905ac0b0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:49.933498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d736e-f83b-4929-8c9c-a5905ac0b0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:49.933607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d736e-f83b-4929-8c9c-a5905ac0b0d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:49.934982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d736e-f83b-4929-8c9c-a5905ac0b0d8 None admin] RBAC: Adding query filter params (role.id=135a36507984447394cee2c2924414bb, user.id=2b4ef5d6d71e41128ebbc24c3b79ddd6, scope.system=all) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:49.935303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d736e-f83b-4929-8c9c-a5905ac0b0d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:49.936705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d736e-f83b-4929-8c9c-a5905ac0b0d8 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:49.938269 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:49.943245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 150/290] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Aug 4 05:05:49 2022] GET /identity/v3/role_assignments?user.id=2b4ef5d6d71e41128ebbc24c3b79ddd6&scope.system=all&role.id=135a36507984447394cee2c2924414bb => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:49.943857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d736e-f83b-4929-8c9c-a5905ac0b0d8 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:49.955294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da202f37-7956-4c76-b190-bc3731d42e20 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:50.018256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb659785-1dd9-4499-a7de-9f7b7dbb2bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:50.019379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb659785-1dd9-4499-a7de-9f7b7dbb2bf5 None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:50.019860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb659785-1dd9-4499-a7de-9f7b7dbb2bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:50.020352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb659785-1dd9-4499-a7de-9f7b7dbb2bf5 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875/users/25e14363a1934a53a5be260e7d09a981/roles/99363062b2b644ee970fba81eb1e5f45` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:50.031475 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb659785-1dd9-4499-a7de-9f7b7dbb2bf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=03f4d63223db43eb85dbf6a826df6875, user_id=25e14363a1934a53a5be260e7d09a981, role_id=99363062b2b644ee970fba81eb1e5f45)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:50.033394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb659785-1dd9-4499-a7de-9f7b7dbb2bf5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:50.058871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d736e-f83b-4929-8c9c-a5905ac0b0d8 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:50.075668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:50.097114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c0f01-9c68-493f-9341-befffd881af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:50.097736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c0f01-9c68-493f-9341-befffd881af0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:50.098006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c0f01-9c68-493f-9341-befffd881af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:50.098265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c0f01-9c68-493f-9341-befffd881af0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:50.118485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 141/291] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:05:49 2022] PUT /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875/users/25e14363a1934a53a5be260e7d09a981/roles/99363062b2b644ee970fba81eb1e5f45 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:05:50.179726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c0f01-9c68-493f-9341-befffd881af0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:50.181234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c0f01-9c68-493f-9341-befffd881af0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:50.295421 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 151/292] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:50.301989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb659785-1dd9-4499-a7de-9f7b7dbb2bf5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:50.449056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb659785-1dd9-4499-a7de-9f7b7dbb2bf5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:50.498295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2de657-c4bd-4f16-819c-d497589380d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:50.498991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2de657-c4bd-4f16-819c-d497589380d8 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:50.499286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2de657-c4bd-4f16-819c-d497589380d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:50.499563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2de657-c4bd-4f16-819c-d497589380d8 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:50.500742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2de657-c4bd-4f16-819c-d497589380d8 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:50.502205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2de657-c4bd-4f16-819c-d497589380d8 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:50.504301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 142/293] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:50 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:50.509700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c0f01-9c68-493f-9341-befffd881af0 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:50.527517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:50.638233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c0f01-9c68-493f-9341-befffd881af0 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:50.674349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20849e6f-4616-404f-898e-d83114fa1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:50.675107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849e6f-4616-404f-898e-d83114fa1944 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:50.675388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849e6f-4616-404f-898e-d83114fa1944 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:50.675664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849e6f-4616-404f-898e-d83114fa1944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:50.676464 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849e6f-4616-404f-898e-d83114fa1944 None admin] RBAC: Adding query filter params (role.id=135a36507984447394cee2c2924414bb, scope.project.id=03f4d63223db43eb85dbf6a826df6875, user.id=35f2a9450e19438980f90f601db98629) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:50.676775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849e6f-4616-404f-898e-d83114fa1944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:50.678268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849e6f-4616-404f-898e-d83114fa1944 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:50.686386 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 152/294] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:50 2022] GET /identity/v3/role_assignments?user.id=35f2a9450e19438980f90f601db98629&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=135a36507984447394cee2c2924414bb => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:51.241993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a47f2-3c61-476d-b87d-b7c43a986e06 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:51.242521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a47f2-3c61-476d-b87d-b7c43a986e06 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:51.242596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a47f2-3c61-476d-b87d-b7c43a986e06 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:51.244234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 143/295] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:51.249868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740ec4e-4b05-4016-a4b4-ce6c3216ab69 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:51.250299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740ec4e-4b05-4016-a4b4-ce6c3216ab69 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:51.250496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740ec4e-4b05-4016-a4b4-ce6c3216ab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:51.272834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-8740ec4e-4b05-4016-a4b4-ce6c3216ab69 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:51.274035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8740ec4e-4b05-4016-a4b4-ce6c3216ab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:51.359262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 153/296] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:51.384377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a47f2-3c61-476d-b87d-b7c43a986e06 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:51.403590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:51.429446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b612d2-d6b7-432a-bfbd-9c3dddec4409 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:51.429654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b612d2-d6b7-432a-bfbd-9c3dddec4409 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:51.429938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b612d2-d6b7-432a-bfbd-9c3dddec4409 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:51.431376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 154/297] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:05:51.437338 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549220-3e3a-413c-8b2f-a27949ee1c02 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:51.437625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549220-3e3a-413c-8b2f-a27949ee1c02 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:51.437902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549220-3e3a-413c-8b2f-a27949ee1c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:51.461437 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-51549220-3e3a-413c-8b2f-a27949ee1c02 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:51.463415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-51549220-3e3a-413c-8b2f-a27949ee1c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:51.466344 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:51.514747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a47f2-3c61-476d-b87d-b7c43a986e06 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:51.554190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 155/298] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:51.564909 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24380947-41da-435f-8504-48d199e80569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:51.565821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24380947-41da-435f-8504-48d199e80569 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:51.566243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24380947-41da-435f-8504-48d199e80569 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:51.566680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24380947-41da-435f-8504-48d199e80569 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:51.577747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549220-3e3a-413c-8b2f-a27949ee1c02 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:51.578781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24380947-41da-435f-8504-48d199e80569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-24380947-41da-435f-8504-48d199e80569 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:51.585275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:51.586159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:51.587698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 144/299] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:51.595766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24380947-41da-435f-8504-48d199e80569 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:51.685246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:51.718550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24380947-41da-435f-8504-48d199e80569 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:51.719044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549220-3e3a-413c-8b2f-a27949ee1c02 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:51.758094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df743886-7383-4b90-9211-1ad0eb426f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:51.759109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743886-7383-4b90-9211-1ad0eb426f6e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:51.759532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743886-7383-4b90-9211-1ad0eb426f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:51.759974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743886-7383-4b90-9211-1ad0eb426f6e None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:51.760878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df743886-7383-4b90-9211-1ad0eb426f6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:51.761318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df743886-7383-4b90-9211-1ad0eb426f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:51.762199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c35839-76db-4ffb-9585-83f810064eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:51.762909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c35839-76db-4ffb-9585-83f810064eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:51.763270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c35839-76db-4ffb-9585-83f810064eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:51.763546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c35839-76db-4ffb-9585-83f810064eb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:51.763960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df743886-7383-4b90-9211-1ad0eb426f6e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:51.764728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c35839-76db-4ffb-9585-83f810064eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:51.766464 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c35839-76db-4ffb-9585-83f810064eb4 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:51.768599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 156/300] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:51.779127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 145/301] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:51.779344 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c35839-76db-4ffb-9585-83f810064eb4 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:51.781144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df743886-7383-4b90-9211-1ad0eb426f6e None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:51.784784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:51.883980 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c35839-76db-4ffb-9585-83f810064eb4 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:51.892784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df743886-7383-4b90-9211-1ad0eb426f6e None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:51.921309 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf38d9-58fe-4708-9c44-0c1129a00c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:51.921972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf38d9-58fe-4708-9c44-0c1129a00c06 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:51.922558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf38d9-58fe-4708-9c44-0c1129a00c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:51.922824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf38d9-58fe-4708-9c44-0c1129a00c06 None admin] PATH_INFO: `/v3/groups` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:51.923485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf38d9-58fe-4708-9c44-0c1129a00c06 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:51.924916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf38d9-58fe-4708-9c44-0c1129a00c06 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:51.932640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62608010-d7d4-4df2-a4cc-205213865041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:51.933458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608010-d7d4-4df2-a4cc-205213865041 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:51.933929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608010-d7d4-4df2-a4cc-205213865041 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:51.934527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608010-d7d4-4df2-a4cc-205213865041 None admin] PATH_INFO: `/v3/users/59bf3531963148e7bc3de591324b1837` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:51.937804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:51.949790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62608010-d7d4-4df2-a4cc-205213865041 None admin] RBAC: Authorizing `identity:get_user(user_id=59bf3531963148e7bc3de591324b1837)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:51.951919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62608010-d7d4-4df2-a4cc-205213865041 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:51.953879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 146/302] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:51 2022] GET /identity/v3/users/59bf3531963148e7bc3de591324b1837 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:51.959661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62608010-d7d4-4df2-a4cc-205213865041 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:52.010671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 157/303] 10.222.0.46 () {60 vars in 1134 bytes} [Thu Aug 4 05:05:51 2022] POST /identity/v3/groups => generated 229 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:05:52.088814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62608010-d7d4-4df2-a4cc-205213865041 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:52.129063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677e95d-9e11-4454-a8b2-5e9ce637ed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:52.130154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e95d-9e11-4454-a8b2-5e9ce637ed0a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:52.130670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e95d-9e11-4454-a8b2-5e9ce637ed0a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:52.131137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e95d-9e11-4454-a8b2-5e9ce637ed0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:52.132133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677e95d-9e11-4454-a8b2-5e9ce637ed0a None admin] RBAC: Adding query filter params (role.id=99363062b2b644ee970fba81eb1e5f45, user.id=59bf3531963148e7bc3de591324b1837, scope.system=all) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:52.132636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677e95d-9e11-4454-a8b2-5e9ce637ed0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:52.134299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677e95d-9e11-4454-a8b2-5e9ce637ed0a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:52.141598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 147/304] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Aug 4 05:05:51 2022] GET /identity/v3/role_assignments?user.id=59bf3531963148e7bc3de591324b1837&scope.system=all&role.id=99363062b2b644ee970fba81eb1e5f45 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:52.427168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c5c9-50f5-4cb1-b866-d2afa93b11e5 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:52.427709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c5c9-50f5-4cb1-b866-d2afa93b11e5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:52.427709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668c5c9-50f5-4cb1-b866-d2afa93b11e5 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:52.429353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 158/305] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:52.435848 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f839844-d90e-418e-8a77-a8104feb156d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:52.436325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f839844-d90e-418e-8a77-a8104feb156d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:52.436397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f839844-d90e-418e-8a77-a8104feb156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:52.456041 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-3f839844-d90e-418e-8a77-a8104feb156d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:52.457233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3f839844-d90e-418e-8a77-a8104feb156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:52.515076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:52.530862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 148/306] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:52.553858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668c5c9-50f5-4cb1-b866-d2afa93b11e5 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:52.578618 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc863f-70c8-488f-b599-88514e6736cc None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:52.579133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc863f-70c8-488f-b599-88514e6736cc None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:52.579528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc863f-70c8-488f-b599-88514e6736cc None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:52.581245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 149/307] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:52.586635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37a9c5-6371-4d8e-8f8a-d615edde0a81 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:52.587039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37a9c5-6371-4d8e-8f8a-d615edde0a81 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:52.587380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37a9c5-6371-4d8e-8f8a-d615edde0a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:52.606239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-6c37a9c5-6371-4d8e-8f8a-d615edde0a81 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:52.607577 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6c37a9c5-6371-4d8e-8f8a-d615edde0a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:52.630956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:52.671775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668c5c9-50f5-4cb1-b866-d2afa93b11e5 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:52.690839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 150/308] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:52.715170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37a9c5-6371-4d8e-8f8a-d615edde0a81 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:52.718402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b45ed-c307-49d8-92c8-fe4faa1da4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:52.719288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b45ed-c307-49d8-92c8-fe4faa1da4ee None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:52.719748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b45ed-c307-49d8-92c8-fe4faa1da4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:52.720166 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b45ed-c307-49d8-92c8-fe4faa1da4ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:52.736686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b45ed-c307-49d8-92c8-fe4faa1da4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-b86b45ed-c307-49d8-92c8-fe4faa1da4ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:52.743839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:52.744739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:52.745567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 159/309] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:52.753638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b45ed-c307-49d8-92c8-fe4faa1da4ee None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:52.850284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37a9c5-6371-4d8e-8f8a-d615edde0a81 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:52.872705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b45ed-c307-49d8-92c8-fe4faa1da4ee None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:52.876663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:52.900171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70da4e-9e95-4a3a-8eab-ddfa1c205099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:52.900820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70da4e-9e95-4a3a-8eab-ddfa1c205099 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:52.901100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70da4e-9e95-4a3a-8eab-ddfa1c205099 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:52.901388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70da4e-9e95-4a3a-8eab-ddfa1c205099 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:52.902057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:52.913722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8a185-52db-43cb-88eb-333e22aa919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:52.914772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a185-52db-43cb-88eb-333e22aa919d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:52.915316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a185-52db-43cb-88eb-333e22aa919d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:52.915868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a185-52db-43cb-88eb-333e22aa919d None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:52.916502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70da4e-9e95-4a3a-8eab-ddfa1c205099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:52.916968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8a185-52db-43cb-88eb-333e22aa919d None admin] RBAC: Adding query filter params (name=member) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:52.917435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8a185-52db-43cb-88eb-333e22aa919d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:52.919064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8a185-52db-43cb-88eb-333e22aa919d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-3f70da4e-9e95-4a3a-8eab-ddfa1c205099 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:52.922662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:52.923537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:52.924468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 151/310] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:52.932215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70da4e-9e95-4a3a-8eab-ddfa1c205099 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:52.934353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 160/311] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:52.943628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8a185-52db-43cb-88eb-333e22aa919d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:53.055481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8a185-52db-43cb-88eb-333e22aa919d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:53.059580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70da4e-9e95-4a3a-8eab-ddfa1c205099 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:53.095276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07af7f-653a-4f60-a8e0-45d84396a153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:53.096343 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07af7f-653a-4f60-a8e0-45d84396a153 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:53.096976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07af7f-653a-4f60-a8e0-45d84396a153 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:53.097451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07af7f-653a-4f60-a8e0-45d84396a153 None admin] PATH_INFO: `/v3/users/2b4ef5d6d71e41128ebbc24c3b79ddd6` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:53.099055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07af7f-653a-4f60-a8e0-45d84396a153 None admin] RBAC: Authorizing `identity:get_user(user_id=2b4ef5d6d71e41128ebbc24c3b79ddd6)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:53.101171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07af7f-653a-4f60-a8e0-45d84396a153 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:53.101597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7a6e3-ea88-4b76-9bc8-8a68b90ae79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:53.102209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7a6e3-ea88-4b76-9bc8-8a68b90ae79d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:53.102514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7a6e3-ea88-4b76-9bc8-8a68b90ae79d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:53.102788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7a6e3-ea88-4b76-9bc8-8a68b90ae79d None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:53.103498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7a6e3-ea88-4b76-9bc8-8a68b90ae79d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:53.103799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7a6e3-ea88-4b76-9bc8-8a68b90ae79d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:53.105447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7a6e3-ea88-4b76-9bc8-8a68b90ae79d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:53.109589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 161/312] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:52 2022] GET /identity/v3/users/2b4ef5d6d71e41128ebbc24c3b79ddd6 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:53.111209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07af7f-653a-4f60-a8e0-45d84396a153 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:53.114350 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 152/313] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:53.120636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7a6e3-ea88-4b76-9bc8-8a68b90ae79d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:53.184859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:53.186694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:53.242258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07af7f-653a-4f60-a8e0-45d84396a153 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:53.255256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7a6e3-ea88-4b76-9bc8-8a68b90ae79d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:53.282823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef814218-e462-464a-ac1c-e67350c25eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:53.283285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef814218-e462-464a-ac1c-e67350c25eab None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:53.283570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef814218-e462-464a-ac1c-e67350c25eab None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:53.283847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef814218-e462-464a-ac1c-e67350c25eab None admin] PATH_INFO: `/v3/system/users/2b4ef5d6d71e41128ebbc24c3b79ddd6/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:53.285323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef814218-e462-464a-ac1c-e67350c25eab None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2b4ef5d6d71e41128ebbc24c3b79ddd6, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:53.286823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef814218-e462-464a-ac1c-e67350c25eab None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:53.300104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eb023-5361-482b-a075-4550d7bcef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:53.300882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eb023-5361-482b-a075-4550d7bcef78 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:53.301211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eb023-5361-482b-a075-4550d7bcef78 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:53.301494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eb023-5361-482b-a075-4550d7bcef78 None admin] PATH_INFO: `/v3/users/25e14363a1934a53a5be260e7d09a981` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:53.302718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1eb023-5361-482b-a075-4550d7bcef78 None admin] RBAC: Authorizing `identity:get_user(user_id=25e14363a1934a53a5be260e7d09a981)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:53.304150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1eb023-5361-482b-a075-4550d7bcef78 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:53.306159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 153/314] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:53 2022] GET /identity/v3/users/25e14363a1934a53a5be260e7d09a981 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:53.312202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eb023-5361-482b-a075-4550d7bcef78 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:53.396961 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 162/315] 10.222.0.46 () {58 vars in 1334 bytes} [Thu Aug 4 05:05:53 2022] PUT /identity/v3/system/users/2b4ef5d6d71e41128ebbc24c3b79ddd6/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:05:53.424037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eb023-5361-482b-a075-4550d7bcef78 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:53.435392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:53.464627 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7d58-e8ab-4d2b-b305-697f034ac812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:53.465298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7d58-e8ab-4d2b-b305-697f034ac812 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:53.466203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7d58-e8ab-4d2b-b305-697f034ac812 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:53.466526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a7d58-e8ab-4d2b-b305-697f034ac812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:53.547950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a7d58-e8ab-4d2b-b305-697f034ac812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:53.549343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a7d58-e8ab-4d2b-b305-697f034ac812 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:53.662144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 154/316] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 05:05:53.667682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef814218-e462-464a-ac1c-e67350c25eab None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:53.784807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef814218-e462-464a-ac1c-e67350c25eab None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:53.806507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:53.820949 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4fb77-cb26-4efb-b161-305301601e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:53.821599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4fb77-cb26-4efb-b161-305301601e6a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:53.821881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4fb77-cb26-4efb-b161-305301601e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:53.822157 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4fb77-cb26-4efb-b161-305301601e6a None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:53.823631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4fb77-cb26-4efb-b161-305301601e6a None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:53.825968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4fb77-cb26-4efb-b161-305301601e6a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:53.828039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 163/317] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:53 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:53.833685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7d58-e8ab-4d2b-b305-697f034ac812 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:53.847573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:53.990579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a7d58-e8ab-4d2b-b305-697f034ac812 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:54.054101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c65d39-83f0-40df-ae9d-dc08165cb31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:54.055256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c65d39-83f0-40df-ae9d-dc08165cb31b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:54.055747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c65d39-83f0-40df-ae9d-dc08165cb31b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:54.056318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c65d39-83f0-40df-ae9d-dc08165cb31b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:54.058053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c65d39-83f0-40df-ae9d-dc08165cb31b None admin] RBAC: Adding query filter params (role.id=99363062b2b644ee970fba81eb1e5f45, scope.project.id=03f4d63223db43eb85dbf6a826df6875, user.id=25e14363a1934a53a5be260e7d09a981) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:54.058581 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c65d39-83f0-40df-ae9d-dc08165cb31b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:54.061864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c65d39-83f0-40df-ae9d-dc08165cb31b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:54.073802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 155/318] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:05:53 2022] GET /identity/v3/role_assignments?user.id=25e14363a1934a53a5be260e7d09a981&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=99363062b2b644ee970fba81eb1e5f45 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:54.245005 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf531a-bef0-456f-89f9-96b3ff9ac7e5 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:54.245290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf531a-bef0-456f-89f9-96b3ff9ac7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:54.245533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf531a-bef0-456f-89f9-96b3ff9ac7e5 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:54.247798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 164/319] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:54.253436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d81ec-edfb-4a61-b1bc-ed2ad489ba62 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:54.253835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d81ec-edfb-4a61-b1bc-ed2ad489ba62 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:54.254207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d81ec-edfb-4a61-b1bc-ed2ad489ba62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:54.271916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c59d-19ef-486e-a4f9-ed03838ca49c None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:54.272335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c59d-19ef-486e-a4f9-ed03838ca49c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:54.272730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c59d-19ef-486e-a4f9-ed03838ca49c None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:54.274492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 165/320] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:05:54.275983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ad4d81ec-edfb-4a61-b1bc-ed2ad489ba62 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:54.277309 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ad4d81ec-edfb-4a61-b1bc-ed2ad489ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:54.279598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a96629-fbe6-4d90-ab10-5bf41afe8bb4 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:54.279728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a96629-fbe6-4d90-ab10-5bf41afe8bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:54.279990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a96629-fbe6-4d90-ab10-5bf41afe8bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:54.299288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-23a96629-fbe6-4d90-ab10-5bf41afe8bb4 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:54.300450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-23a96629-fbe6-4d90-ab10-5bf41afe8bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:54.355371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 156/321] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:54.378794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d81ec-edfb-4a61-b1bc-ed2ad489ba62 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:54.381013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:54.382237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 166/322] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:54.404649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a96629-fbe6-4d90-ab10-5bf41afe8bb4 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:54.489067 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d81ec-edfb-4a61-b1bc-ed2ad489ba62 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:54.511327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a96629-fbe6-4d90-ab10-5bf41afe8bb4 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:54.524811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8062c74-22eb-4e0f-8ed9-deb86a6e1fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:54.525453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8062c74-22eb-4e0f-8ed9-deb86a6e1fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:54.525733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8062c74-22eb-4e0f-8ed9-deb86a6e1fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:54.526014 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8062c74-22eb-4e0f-8ed9-deb86a6e1fa1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:54.531302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:54.536939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8062c74-22eb-4e0f-8ed9-deb86a6e1fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-b8062c74-22eb-4e0f-8ed9-deb86a6e1fa1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:54.541888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:54.542793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:54.544209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 157/323] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:05:54.549796 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8062c74-22eb-4e0f-8ed9-deb86a6e1fa1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:54.552369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422819-1720-4956-8eb7-461c8d4db895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:54.553133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422819-1720-4956-8eb7-461c8d4db895 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:54.553407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422819-1720-4956-8eb7-461c8d4db895 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:54.553791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422819-1720-4956-8eb7-461c8d4db895 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:54.554986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e422819-1720-4956-8eb7-461c8d4db895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:54.556410 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e422819-1720-4956-8eb7-461c8d4db895 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:54.558177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 167/324] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:05:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:54.564751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422819-1720-4956-8eb7-461c8d4db895 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:54.612071 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:54.653983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8062c74-22eb-4e0f-8ed9-deb86a6e1fa1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:54.672295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422819-1720-4956-8eb7-461c8d4db895 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:54.691902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2d051-00d2-4386-a6f9-14bb00060200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:54.692581 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2d051-00d2-4386-a6f9-14bb00060200 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:54.692865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2d051-00d2-4386-a6f9-14bb00060200 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:54.693144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2d051-00d2-4386-a6f9-14bb00060200 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:54.693868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2d051-00d2-4386-a6f9-14bb00060200 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:54.694174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2d051-00d2-4386-a6f9-14bb00060200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:54.696324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2d051-00d2-4386-a6f9-14bb00060200 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:54.711250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d77a4a-6310-4e0d-a434-87d6a473d0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:54.711689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 158/325] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:05:54.711963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77a4a-6310-4e0d-a434-87d6a473d0b4 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:54.712244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77a4a-6310-4e0d-a434-87d6a473d0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:54.712630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77a4a-6310-4e0d-a434-87d6a473d0b4 None admin] PATH_INFO: `/v3/groups` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:54.713327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d77a4a-6310-4e0d-a434-87d6a473d0b4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:54.714867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d77a4a-6310-4e0d-a434-87d6a473d0b4 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:54.718028 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2d051-00d2-4386-a6f9-14bb00060200 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:54.821082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2d051-00d2-4386-a6f9-14bb00060200 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:54.844438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:54.854655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7779b9-259d-4ef0-91f0-1fc1915d04ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:54.855287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7779b9-259d-4ef0-91f0-1fc1915d04ff None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:54.855566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7779b9-259d-4ef0-91f0-1fc1915d04ff None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:54.855858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7779b9-259d-4ef0-91f0-1fc1915d04ff None admin] PATH_INFO: `/v3/users/59bf3531963148e7bc3de591324b1837` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:54.857570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7779b9-259d-4ef0-91f0-1fc1915d04ff None admin] RBAC: Authorizing `identity:get_user(user_id=59bf3531963148e7bc3de591324b1837)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:54.859030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7779b9-259d-4ef0-91f0-1fc1915d04ff None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:54.860689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 159/326] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:54 2022] GET /identity/v3/users/59bf3531963148e7bc3de591324b1837 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:54.866226 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7779b9-259d-4ef0-91f0-1fc1915d04ff None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:54.886335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 168/327] 10.222.0.46 () {60 vars in 1134 bytes} [Thu Aug 4 05:05:54 2022] POST /identity/v3/groups => generated 226 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:05:54.986355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7779b9-259d-4ef0-91f0-1fc1915d04ff None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:55.022355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2c093-482f-410b-8123-5f8117968e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:55.022866 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2c093-482f-410b-8123-5f8117968e2d None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:55.023144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2c093-482f-410b-8123-5f8117968e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:55.023418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2c093-482f-410b-8123-5f8117968e2d None admin] PATH_INFO: `/v3/system/users/59bf3531963148e7bc3de591324b1837/roles/99363062b2b644ee970fba81eb1e5f45` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:55.024940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2c093-482f-410b-8123-5f8117968e2d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=59bf3531963148e7bc3de591324b1837, role_id=99363062b2b644ee970fba81eb1e5f45)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:55.026344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2c093-482f-410b-8123-5f8117968e2d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:55.107330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 160/328] 10.222.0.46 () {58 vars in 1334 bytes} [Thu Aug 4 05:05:54 2022] PUT /identity/v3/system/users/59bf3531963148e7bc3de591324b1837/roles/99363062b2b644ee970fba81eb1e5f45 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:05:55.647686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e6389-5784-4092-a4a2-84859f842e55 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:55.648180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e6389-5784-4092-a4a2-84859f842e55 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:55.648567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e6389-5784-4092-a4a2-84859f842e55 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:55.650175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 169/329] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:55.656585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08a8bd-d22e-407d-a64a-6e643b044b84 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:55.657058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08a8bd-d22e-407d-a64a-6e643b044b84 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:55.657345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08a8bd-d22e-407d-a64a-6e643b044b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:55.679737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-db08a8bd-d22e-407d-a64a-6e643b044b84 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:55.681116 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-db08a8bd-d22e-407d-a64a-6e643b044b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:55.742888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:55.761183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 161/330] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:05:55.790187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e6389-5784-4092-a4a2-84859f842e55 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:55.850731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:55.933014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e6389-5784-4092-a4a2-84859f842e55 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:55.975240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88b860-f2f5-416c-aa3a-a347831d34aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:55.975885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b860-f2f5-416c-aa3a-a347831d34aa None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:55.976162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b860-f2f5-416c-aa3a-a347831d34aa None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:55.976435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b860-f2f5-416c-aa3a-a347831d34aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:55.991616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88b860-f2f5-416c-aa3a-a347831d34aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-6f88b860-f2f5-416c-aa3a-a347831d34aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:55.997116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:55.998004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:55.998831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 170/331] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:56.004392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08a8bd-d22e-407d-a64a-6e643b044b84 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:56.164171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08a8bd-d22e-407d-a64a-6e643b044b84 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:56.219176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c419c1-ff63-499c-be84-6f41e7dcd6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:56.219890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c419c1-ff63-499c-be84-6f41e7dcd6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:56.220169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c419c1-ff63-499c-be84-6f41e7dcd6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:56.220439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c419c1-ff63-499c-be84-6f41e7dcd6b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:56.221169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c419c1-ff63-499c-be84-6f41e7dcd6b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:56.221468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c419c1-ff63-499c-be84-6f41e7dcd6b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:56.222940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c419c1-ff63-499c-be84-6f41e7dcd6b8 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:56.236504 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 162/332] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:56.242215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88b860-f2f5-416c-aa3a-a347831d34aa None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:56.395281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88b860-f2f5-416c-aa3a-a347831d34aa None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:56.409149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:56.439436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e466b-810e-4613-ba6e-e32746dfb596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:56.440119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e466b-810e-4613-ba6e-e32746dfb596 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:56.440401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e466b-810e-4613-ba6e-e32746dfb596 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:56.440674 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e466b-810e-4613-ba6e-e32746dfb596 None admin] PATH_INFO: `/v3/users/2b4ef5d6d71e41128ebbc24c3b79ddd6` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:56.447370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e466b-810e-4613-ba6e-e32746dfb596 None admin] RBAC: Authorizing `identity:get_user(user_id=2b4ef5d6d71e41128ebbc24c3b79ddd6)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:56.449206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e466b-810e-4613-ba6e-e32746dfb596 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:56.452005 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 171/333] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:56 2022] GET /identity/v3/users/2b4ef5d6d71e41128ebbc24c3b79ddd6 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:56.457622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c419c1-ff63-499c-be84-6f41e7dcd6b8 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:56.538064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:56.602935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c419c1-ff63-499c-be84-6f41e7dcd6b8 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:56.647315 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe3508-b6fc-4e6e-a6e4-f1524fbbf0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:56.647937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3508-b6fc-4e6e-a6e4-f1524fbbf0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:56.648213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3508-b6fc-4e6e-a6e4-f1524fbbf0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:56.648489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3508-b6fc-4e6e-a6e4-f1524fbbf0e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:56.649283 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe3508-b6fc-4e6e-a6e4-f1524fbbf0e6 None admin] RBAC: Adding query filter params (role.id=135a36507984447394cee2c2924414bb, user.id=2b4ef5d6d71e41128ebbc24c3b79ddd6, scope.system=all) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:56.649590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe3508-b6fc-4e6e-a6e4-f1524fbbf0e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:56.651054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe3508-b6fc-4e6e-a6e4-f1524fbbf0e6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:56.670569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 163/334] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Aug 4 05:05:56 2022] GET /identity/v3/role_assignments?user.id=2b4ef5d6d71e41128ebbc24c3b79ddd6&scope.system=all&role.id=135a36507984447394cee2c2924414bb => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:57.523779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd8819-96f8-4cf4-adf6-43f9ca542a40 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:57.524270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd8819-96f8-4cf4-adf6-43f9ca542a40 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:57.524270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd8819-96f8-4cf4-adf6-43f9ca542a40 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:57.525893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 172/335] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:57.532598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96782355-efd7-4c4b-8c38-b0f22b327944 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:57.532888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96782355-efd7-4c4b-8c38-b0f22b327944 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:57.533160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96782355-efd7-4c4b-8c38-b0f22b327944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:57.563317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-96782355-efd7-4c4b-8c38-b0f22b327944 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:57.564520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-96782355-efd7-4c4b-8c38-b0f22b327944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:57.584821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7954c9f-eae9-4c14-89bb-3b101f07f0bb None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:57.585144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7954c9f-eae9-4c14-89bb-3b101f07f0bb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:57.585356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7954c9f-eae9-4c14-89bb-3b101f07f0bb None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:57.586808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 173/336] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:05:57.594018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abeb51-d65a-41e4-bf2b-d15051755e97 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:57.594649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abeb51-d65a-41e4-bf2b-d15051755e97 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:57.595141 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abeb51-d65a-41e4-bf2b-d15051755e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:57.627920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-94abeb51-d65a-41e4-bf2b-d15051755e97 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:57.629502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-94abeb51-d65a-41e4-bf2b-d15051755e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:57.676290 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 164/337] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:57.749272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 174/338] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:57.764334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96782355-efd7-4c4b-8c38-b0f22b327944 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:57.788993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abeb51-d65a-41e4-bf2b-d15051755e97 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:57.813588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:57.908155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96782355-efd7-4c4b-8c38-b0f22b327944 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:57.953978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d6951-40be-42e9-97cc-d36f019a9b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:57.955099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6951-40be-42e9-97cc-d36f019a9b7a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:57.955583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6951-40be-42e9-97cc-d36f019a9b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:57.956074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6951-40be-42e9-97cc-d36f019a9b7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:57.969377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d6951-40be-42e9-97cc-d36f019a9b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-e72d6951-40be-42e9-97cc-d36f019a9b7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:57.975084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:57.976035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:05:57.977234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 165/339] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:57.977926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30304bcd-5b00-4ca8-9152-f7cee8be6f71 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:57.977926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30304bcd-5b00-4ca8-9152-f7cee8be6f71 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:57.978049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30304bcd-5b00-4ca8-9152-f7cee8be6f71 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:57.979882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 166/340] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:57.987647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c90c-5889-4ff4-85c2-226af8244bd6 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:57.987931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c90c-5889-4ff4-85c2-226af8244bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:57.988160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c90c-5889-4ff4-85c2-226af8244bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:58.023256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e4b1c90c-5889-4ff4-85c2-226af8244bd6 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:58.023469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abeb51-d65a-41e4-bf2b-d15051755e97 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:58.024446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e4b1c90c-5889-4ff4-85c2-226af8244bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:58.025847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:58.072895 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee21c3-723c-439c-8dbe-ed142d9e952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:58.073787 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee21c3-723c-439c-8dbe-ed142d9e952c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:58.074224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee21c3-723c-439c-8dbe-ed142d9e952c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:58.075210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee21c3-723c-439c-8dbe-ed142d9e952c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:58.093618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee21c3-723c-439c-8dbe-ed142d9e952c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-c5ee21c3-723c-439c-8dbe-ed142d9e952c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:58.101001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:58.102121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:58.103119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:58.105507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 175/341] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:58.107284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee21c3-723c-439c-8dbe-ed142d9e952c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:58.174150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 167/342] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:58.176541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c90c-5889-4ff4-85c2-226af8244bd6 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:58.239107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:58.321646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee21c3-723c-439c-8dbe-ed142d9e952c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:58.353220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c90c-5889-4ff4-85c2-226af8244bd6 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:58.385374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc7ac0-0fd2-434d-aeee-440633237530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:58.386094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7ac0-0fd2-434d-aeee-440633237530 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:58.386580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7ac0-0fd2-434d-aeee-440633237530 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:58.387013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7ac0-0fd2-434d-aeee-440633237530 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:58.387901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7ac0-0fd2-434d-aeee-440633237530 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:58.388353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7ac0-0fd2-434d-aeee-440633237530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:58.390016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7ac0-0fd2-434d-aeee-440633237530 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:58.399293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75670526-4999-4a1e-8c59-d582b66ac9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:58.400146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75670526-4999-4a1e-8c59-d582b66ac9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:58.400572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75670526-4999-4a1e-8c59-d582b66ac9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:58.401146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75670526-4999-4a1e-8c59-d582b66ac9a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:58.403655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 176/343] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:58.404753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75670526-4999-4a1e-8c59-d582b66ac9a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:58.405221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75670526-4999-4a1e-8c59-d582b66ac9a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:58.407192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc7ac0-0fd2-434d-aeee-440633237530 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:58.407817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75670526-4999-4a1e-8c59-d582b66ac9a6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:58.427715 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 168/344] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:58.428795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75670526-4999-4a1e-8c59-d582b66ac9a6 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:58.477476 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:58.594761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:58.613442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75670526-4999-4a1e-8c59-d582b66ac9a6 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:58.635901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc7ac0-0fd2-434d-aeee-440633237530 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:58.689775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bce03b-24b9-4209-a782-a198c954a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:58.690456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bce03b-24b9-4209-a782-a198c954a424 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:58.690735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bce03b-24b9-4209-a782-a198c954a424 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:58.691009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bce03b-24b9-4209-a782-a198c954a424 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:58.696077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f5ddb-1b08-4346-b3d4-6e853b53fad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:58.696775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f5ddb-1b08-4346-b3d4-6e853b53fad5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:58.697024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f5ddb-1b08-4346-b3d4-6e853b53fad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:58.697304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f5ddb-1b08-4346-b3d4-6e853b53fad5 None admin] PATH_INFO: `/v3/users/59bf3531963148e7bc3de591324b1837` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:58.703248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f5ddb-1b08-4346-b3d4-6e853b53fad5 None admin] RBAC: Authorizing `identity:get_user(user_id=59bf3531963148e7bc3de591324b1837)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:58.704726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bce03b-24b9-4209-a782-a198c954a424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:58.704851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f5ddb-1b08-4346-b3d4-6e853b53fad5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:58.706575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 169/345] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:05:58 2022] GET /identity/v3/users/59bf3531963148e7bc3de591324b1837 => generated 293 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:58.707418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f5ddb-1b08-4346-b3d4-6e853b53fad5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-e6bce03b-24b9-4209-a782-a198c954a424 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:58.712389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:58.718280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 177/346] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:05:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:58.719316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b266e6-407c-4335-9d68-b22c5cc67848 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:58.720238 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b266e6-407c-4335-9d68-b22c5cc67848 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:58.720238 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b266e6-407c-4335-9d68-b22c5cc67848 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:58.721217 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 178/347] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:58.722275 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b266e6-407c-4335-9d68-b22c5cc67848 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:58.905356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f5ddb-1b08-4346-b3d4-6e853b53fad5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:58.908890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:58.932074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b266e6-407c-4335-9d68-b22c5cc67848 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:58.964406 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b124c-2c2e-4a30-ac36-628684e6ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:58.966521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b124c-2c2e-4a30-ac36-628684e6ba4b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:58.967139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b124c-2c2e-4a30-ac36-628684e6ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:58.967560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b124c-2c2e-4a30-ac36-628684e6ba4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:58.988519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7365c-d747-441a-ac8d-bd3f457822be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:58.989457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7365c-d747-441a-ac8d-bd3f457822be None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:58.989793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7365c-d747-441a-ac8d-bd3f457822be None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:58.990071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7365c-d747-441a-ac8d-bd3f457822be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:58.990962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7365c-d747-441a-ac8d-bd3f457822be None admin] RBAC: Adding query filter params (role.id=99363062b2b644ee970fba81eb1e5f45, user.id=59bf3531963148e7bc3de591324b1837, scope.system=all) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:58.991271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7365c-d747-441a-ac8d-bd3f457822be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:58.993704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7365c-d747-441a-ac8d-bd3f457822be None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:59.009645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:59.012940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 179/348] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Aug 4 05:05:58 2022] GET /identity/v3/role_assignments?user.id=59bf3531963148e7bc3de591324b1837&scope.system=all&role.id=99363062b2b644ee970fba81eb1e5f45 => generated 510 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:59.016054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7365c-d747-441a-ac8d-bd3f457822be None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:59.089180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b124c-2c2e-4a30-ac36-628684e6ba4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:59.091656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b124c-2c2e-4a30-ac36-628684e6ba4b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:59.163955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7365c-d747-441a-ac8d-bd3f457822be None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:59.204803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e2ab9-36d4-4199-96e2-858c978789bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:59.205432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e2ab9-36d4-4199-96e2-858c978789bd None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:59.205872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e2ab9-36d4-4199-96e2-858c978789bd None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:59.206337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e2ab9-36d4-4199-96e2-858c978789bd None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:59.207270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e2ab9-36d4-4199-96e2-858c978789bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:59.207719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e2ab9-36d4-4199-96e2-858c978789bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:59.209389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e2ab9-36d4-4199-96e2-858c978789bd None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:59.209915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 170/349] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:59.211306 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187255-5655-42cf-9531-f69571a2bbb0 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:59.211852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187255-5655-42cf-9531-f69571a2bbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:59.212355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187255-5655-42cf-9531-f69571a2bbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:59.220024 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 180/350] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:05:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:59.221219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e2ab9-36d4-4199-96e2-858c978789bd None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:59.231593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:59.232222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-05187255-5655-42cf-9531-f69571a2bbb0 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:05:59.234753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-05187255-5655-42cf-9531-f69571a2bbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:05:59.295198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:59.315882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 171/351] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:05:59.320439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05187255-5655-42cf-9531-f69571a2bbb0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:59.343710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e2ab9-36d4-4199-96e2-858c978789bd None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:59.385248 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daf20a-8c1f-4ada-a058-b8729599a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:59.386258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daf20a-8c1f-4ada-a058-b8729599a76a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:59.386777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daf20a-8c1f-4ada-a058-b8729599a76a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:59.387817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daf20a-8c1f-4ada-a058-b8729599a76a None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:59.389655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11daf20a-8c1f-4ada-a058-b8729599a76a None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:59.391396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11daf20a-8c1f-4ada-a058-b8729599a76a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:59.393436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 181/352] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:59 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:59.399300 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daf20a-8c1f-4ada-a058-b8729599a76a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:59.443867 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05187255-5655-42cf-9531-f69571a2bbb0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:59.483946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5155dd-88d1-4e69-861f-1b760f58f71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:59.484856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5155dd-88d1-4e69-861f-1b760f58f71f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:59.485279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5155dd-88d1-4e69-861f-1b760f58f71f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:59.485710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5155dd-88d1-4e69-861f-1b760f58f71f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:59.488087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:59.517497 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daf20a-8c1f-4ada-a058-b8729599a76a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:59.550279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:59.562174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0c8f-82e7-4004-86af-6d041593e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:59.563253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0c8f-82e7-4004-86af-6d041593e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:59.563727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0c8f-82e7-4004-86af-6d041593e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:59.564207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0c8f-82e7-4004-86af-6d041593e0e9 None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:59.567595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5155dd-88d1-4e69-861f-1b760f58f71f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:59.569361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5155dd-88d1-4e69-861f-1b760f58f71f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:59.571731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce0c8f-82e7-4004-86af-6d041593e0e9 None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:59.573562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce0c8f-82e7-4004-86af-6d041593e0e9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:59.576845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 182/353] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:05:59 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:59.578004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0c8f-82e7-4004-86af-6d041593e0e9 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:59.683297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 172/354] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:05:59.684666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5155dd-88d1-4e69-861f-1b760f58f71f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:59.696352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0c8f-82e7-4004-86af-6d041593e0e9 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:59.741154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5fc38-e364-4567-ab76-0ad71df28d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:59.741808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5fc38-e364-4567-ab76-0ad71df28d03 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:59.742087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5fc38-e364-4567-ab76-0ad71df28d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:59.742424 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5fc38-e364-4567-ab76-0ad71df28d03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:59.753103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:59.760163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5fc38-e364-4567-ab76-0ad71df28d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-c3e5fc38-e364-4567-ab76-0ad71df28d03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:05:59.765499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:05:59.766794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:05:59.767646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 183/355] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:05:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:05:59.768819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc972bb8-bee0-4e1b-8063-e798db3cc3a9 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:59.769294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc972bb8-bee0-4e1b-8063-e798db3cc3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:59.769579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc972bb8-bee0-4e1b-8063-e798db3cc3a9 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:59.775142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 184/356] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:05:59.776049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc972bb8-bee0-4e1b-8063-e798db3cc3a9 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:59.815519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:59.837994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5155dd-88d1-4e69-861f-1b760f58f71f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:05:59.889529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc15528-ddf4-498a-a188-0fb9823f1255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:05:59.890466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc15528-ddf4-498a-a188-0fb9823f1255 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:05:59.890885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc15528-ddf4-498a-a188-0fb9823f1255 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:05:59.891310 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc15528-ddf4-498a-a188-0fb9823f1255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:05:59.892292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc15528-ddf4-498a-a188-0fb9823f1255 None admin] RBAC: Adding query filter params (group.id=9ac31470123d4e2bbefa0dd2b8904af0, role.id=135a36507984447394cee2c2924414bb, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:05:59.893349 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc15528-ddf4-498a-a188-0fb9823f1255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:05:59.895517 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc15528-ddf4-498a-a188-0fb9823f1255 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:05:59.902417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 173/357] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 4 05:05:59 2022] GET /identity/v3/role_assignments?group.id=9ac31470123d4e2bbefa0dd2b8904af0&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=135a36507984447394cee2c2924414bb => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:05:59.904916 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc15528-ddf4-498a-a188-0fb9823f1255 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:05:59.962502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc972bb8-bee0-4e1b-8063-e798db3cc3a9 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:00.021779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448e023-ceeb-4339-af42-5d2f45713861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:00.023932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e023-ceeb-4339-af42-5d2f45713861 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:00.023932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e023-ceeb-4339-af42-5d2f45713861 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:00.023932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448e023-ceeb-4339-af42-5d2f45713861 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:00.024326 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448e023-ceeb-4339-af42-5d2f45713861 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:00.025834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448e023-ceeb-4339-af42-5d2f45713861 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:00.028577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 185/358] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:05:59 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:00.030376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522dd1d-c142-4a1e-8e96-4f32fa115da4 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:00.031812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522dd1d-c142-4a1e-8e96-4f32fa115da4 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:00.031943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522dd1d-c142-4a1e-8e96-4f32fa115da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:00.060909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-8522dd1d-c142-4a1e-8e96-4f32fa115da4 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:00.063796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8522dd1d-c142-4a1e-8e96-4f32fa115da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:00.089977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc15528-ddf4-498a-a188-0fb9823f1255 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:00.149990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:00.161582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b316c2c-de44-4445-a477-c7dcc9d172bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:00.173740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b316c2c-de44-4445-a477-c7dcc9d172bf None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:00.173740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b316c2c-de44-4445-a477-c7dcc9d172bf None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:00.173961 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 186/359] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:00.174037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b316c2c-de44-4445-a477-c7dcc9d172bf None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:00.174037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b316c2c-de44-4445-a477-c7dcc9d172bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:00.174037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b316c2c-de44-4445-a477-c7dcc9d172bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:00.174236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e105f-7678-45db-84e8-7ade23a8fd79 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:00.174236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e105f-7678-45db-84e8-7ade23a8fd79 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:00.174236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e105f-7678-45db-84e8-7ade23a8fd79 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:00.174974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b316c2c-de44-4445-a477-c7dcc9d172bf None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:00.175061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 187/360] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:00.175061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e105f-7678-45db-84e8-7ade23a8fd79 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:00.190476 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 174/361] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:05:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:00.191889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c28f21-7382-429b-bdb1-04373338796d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:00.192178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c28f21-7382-429b-bdb1-04373338796d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:00.192490 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c28f21-7382-429b-bdb1-04373338796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:00.213823 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c4c28f21-7382-429b-bdb1-04373338796d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:00.217298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c4c28f21-7382-429b-bdb1-04373338796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:00.228817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:00.316113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e105f-7678-45db-84e8-7ade23a8fd79 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:00.316305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 175/362] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:00.323155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c28f21-7382-429b-bdb1-04373338796d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:00.374630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd334a-88ae-4aaf-a6b2-5e0509128984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:00.378724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd334a-88ae-4aaf-a6b2-5e0509128984 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:00.379214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd334a-88ae-4aaf-a6b2-5e0509128984 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:00.379668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd334a-88ae-4aaf-a6b2-5e0509128984 None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:00.381265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd334a-88ae-4aaf-a6b2-5e0509128984 None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:00.382698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd334a-88ae-4aaf-a6b2-5e0509128984 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:00.384529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 188/363] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:00 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:00.385522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd334a-88ae-4aaf-a6b2-5e0509128984 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:00.479930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:00.515985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c28f21-7382-429b-bdb1-04373338796d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:00.542216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd334a-88ae-4aaf-a6b2-5e0509128984 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:00.576925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b6d72-ebd4-442a-9869-0c9e611427a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:00.577803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b6d72-ebd4-442a-9869-0c9e611427a7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:00.578250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b6d72-ebd4-442a-9869-0c9e611427a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:00.578712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b6d72-ebd4-442a-9869-0c9e611427a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:00.595388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:00.604521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000da7b-368c-4129-b973-fe6c30a54951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:00.605178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000da7b-368c-4129-b973-fe6c30a54951 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:00.605458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000da7b-368c-4129-b973-fe6c30a54951 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:00.605731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000da7b-368c-4129-b973-fe6c30a54951 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:00.618588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000da7b-368c-4129-b973-fe6c30a54951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-5000da7b-368c-4129-b973-fe6c30a54951 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:00.626032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:00.627129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:00.627932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:00.634609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 189/364] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:06:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:00.634609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000da7b-368c-4129-b973-fe6c30a54951 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:00.700427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b6d72-ebd4-442a-9869-0c9e611427a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:00.703636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b6d72-ebd4-442a-9869-0c9e611427a7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:00.821885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000da7b-368c-4129-b973-fe6c30a54951 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:00.866653 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:00.884409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 176/365] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:00.885277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b6d72-ebd4-442a-9869-0c9e611427a7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:00.893185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfd778-1ff3-41d4-9588-065f42c78b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:00.894101 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfd778-1ff3-41d4-9588-065f42c78b7c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:00.894576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfd778-1ff3-41d4-9588-065f42c78b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:00.894988 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfd778-1ff3-41d4-9588-065f42c78b7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:00.909765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfd778-1ff3-41d4-9588-065f42c78b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-64dfd778-1ff3-41d4-9588-065f42c78b7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:00.917515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:00.919873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:00.921914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 190/366] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:00.923697 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfd778-1ff3-41d4-9588-065f42c78b7c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:00.938728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:01.030525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b6d72-ebd4-442a-9869-0c9e611427a7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:01.072921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4998b-f16d-4c51-b36a-b18cd79a23c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:01.074339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4998b-f16d-4c51-b36a-b18cd79a23c9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:01.075790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4998b-f16d-4c51-b36a-b18cd79a23c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:01.076336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4998b-f16d-4c51-b36a-b18cd79a23c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:01.077294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4998b-f16d-4c51-b36a-b18cd79a23c9 None admin] RBAC: Adding query filter params (group.id=9ac31470123d4e2bbefa0dd2b8904af0, role.id=ac5a79a4ca8d49298d455da9928e5a4f, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:01.077608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4998b-f16d-4c51-b36a-b18cd79a23c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:01.079397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4998b-f16d-4c51-b36a-b18cd79a23c9 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:01.082503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfd778-1ff3-41d4-9588-065f42c78b7c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:01.091534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 177/367] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 4 05:06:00 2022] GET /identity/v3/role_assignments?group.id=9ac31470123d4e2bbefa0dd2b8904af0&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=ac5a79a4ca8d49298d455da9928e5a4f => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:01.094804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4998b-f16d-4c51-b36a-b18cd79a23c9 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:01.132156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b64bbf-6782-4314-bf6a-a391b41b6e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:01.132974 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b64bbf-6782-4314-bf6a-a391b41b6e27 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:01.133309 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b64bbf-6782-4314-bf6a-a391b41b6e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:01.133704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b64bbf-6782-4314-bf6a-a391b41b6e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:01.134611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b64bbf-6782-4314-bf6a-a391b41b6e27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:01.135053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b64bbf-6782-4314-bf6a-a391b41b6e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:01.137912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b64bbf-6782-4314-bf6a-a391b41b6e27 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:01.154355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 191/368] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:01.154355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b64bbf-6782-4314-bf6a-a391b41b6e27 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:01.259408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:01.290230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4998b-f16d-4c51-b36a-b18cd79a23c9 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:01.302570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:01.353421 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1bd4-5274-4383-8b70-6b06dc8b6a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:01.354196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1bd4-5274-4383-8b70-6b06dc8b6a07 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:01.354875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1bd4-5274-4383-8b70-6b06dc8b6a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:01.355157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1bd4-5274-4383-8b70-6b06dc8b6a07 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:01.357892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a1bd4-5274-4383-8b70-6b06dc8b6a07 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:01.361411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a1bd4-5274-4383-8b70-6b06dc8b6a07 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:01.361652 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b64bbf-6782-4314-bf6a-a391b41b6e27 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:01.365803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 178/369] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:01 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:01.366748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1bd4-5274-4383-8b70-6b06dc8b6a07 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:01.407414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f393c6-05bf-47fe-8fbc-e60bfabc270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:01.408153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f393c6-05bf-47fe-8fbc-e60bfabc270f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:01.408426 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f393c6-05bf-47fe-8fbc-e60bfabc270f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:01.408738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f393c6-05bf-47fe-8fbc-e60bfabc270f None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:01.409481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f393c6-05bf-47fe-8fbc-e60bfabc270f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:01.409884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f393c6-05bf-47fe-8fbc-e60bfabc270f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:01.411409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f393c6-05bf-47fe-8fbc-e60bfabc270f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:01.422710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 192/370] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:01.423565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f393c6-05bf-47fe-8fbc-e60bfabc270f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:01.541949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1bd4-5274-4383-8b70-6b06dc8b6a07 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:01.572373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f393c6-05bf-47fe-8fbc-e60bfabc270f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:01.587667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:01.604639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a3c09-9b08-47e0-bf3d-2727e86cd589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:01.605096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3c09-9b08-47e0-bf3d-2727e86cd589 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:01.605372 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3c09-9b08-47e0-bf3d-2727e86cd589 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:01.605644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a3c09-9b08-47e0-bf3d-2727e86cd589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:01.622644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804ec7d-cef3-48d8-b982-1c1150bc07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:01.623713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804ec7d-cef3-48d8-b982-1c1150bc07bb None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:01.624225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804ec7d-cef3-48d8-b982-1c1150bc07bb None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:01.624692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804ec7d-cef3-48d8-b982-1c1150bc07bb None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:01.627062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804ec7d-cef3-48d8-b982-1c1150bc07bb None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:01.629037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804ec7d-cef3-48d8-b982-1c1150bc07bb None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:01.635265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 193/371] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:01 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:01.635265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804ec7d-cef3-48d8-b982-1c1150bc07bb None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:01.686786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:01.748093 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a3c09-9b08-47e0-bf3d-2727e86cd589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:01.750821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a3c09-9b08-47e0-bf3d-2727e86cd589 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:01.806532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804ec7d-cef3-48d8-b982-1c1150bc07bb None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:01.853703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad1a16-9478-4093-80e3-59cec3e3a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:01.855662 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad1a16-9478-4093-80e3-59cec3e3a54f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:01.856196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad1a16-9478-4093-80e3-59cec3e3a54f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:01.856719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad1a16-9478-4093-80e3-59cec3e3a54f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:01.939966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 179/372] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:01.941110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a3c09-9b08-47e0-bf3d-2727e86cd589 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:01.976768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:02.026299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad1a16-9478-4093-80e3-59cec3e3a54f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:02.031444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad1a16-9478-4093-80e3-59cec3e3a54f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:02.034478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:02.071532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a3c09-9b08-47e0-bf3d-2727e86cd589 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:02.122433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243a536-a119-47ee-9bce-ef0c32a01cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:02.122968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243a536-a119-47ee-9bce-ef0c32a01cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:02.123237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243a536-a119-47ee-9bce-ef0c32a01cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:02.123505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243a536-a119-47ee-9bce-ef0c32a01cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:02.124360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243a536-a119-47ee-9bce-ef0c32a01cc1 None admin] RBAC: Adding query filter params (group.id=9ac31470123d4e2bbefa0dd2b8904af0, role.id=135a36507984447394cee2c2924414bb, scope.project.id=03f4d63223db43eb85dbf6a826df6875) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:02.124735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243a536-a119-47ee-9bce-ef0c32a01cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:02.126158 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243a536-a119-47ee-9bce-ef0c32a01cc1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:02.134852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 180/373] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 4 05:06:01 2022] GET /identity/v3/role_assignments?group.id=9ac31470123d4e2bbefa0dd2b8904af0&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=135a36507984447394cee2c2924414bb => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:02.135720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243a536-a119-47ee-9bce-ef0c32a01cc1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:02.278787 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 194/374] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:02.282631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad1a16-9478-4093-80e3-59cec3e3a54f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:02.359782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243a536-a119-47ee-9bce-ef0c32a01cc1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:02.386120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:02.413808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b516d7-cb59-40d7-9312-759f44a284c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:02.415112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b516d7-cb59-40d7-9312-759f44a284c3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:02.415394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b516d7-cb59-40d7-9312-759f44a284c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:02.415670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b516d7-cb59-40d7-9312-759f44a284c3 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:02.421272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b516d7-cb59-40d7-9312-759f44a284c3 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:02.423129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b516d7-cb59-40d7-9312-759f44a284c3 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:02.425305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 181/375] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:02 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:02.426383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162b02-5a0a-41b9-ad1f-85ac34ec4637 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:02.426650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162b02-5a0a-41b9-ad1f-85ac34ec4637 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:02.426925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162b02-5a0a-41b9-ad1f-85ac34ec4637 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:02.428009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad1a16-9478-4093-80e3-59cec3e3a54f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:02.428474 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 182/376] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:02.434415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162b02-5a0a-41b9-ad1f-85ac34ec4637 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:02.445086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:02.483375 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342453bc-e378-450a-96f2-94d39f52c89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:02.483375 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342453bc-e378-450a-96f2-94d39f52c89a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:02.483755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342453bc-e378-450a-96f2-94d39f52c89a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:02.483882 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342453bc-e378-450a-96f2-94d39f52c89a None admin] PATH_INFO: `/v3/projects/d0fa97262e904ea29696d2d9cb8b9bc3` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:02.485640 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342453bc-e378-450a-96f2-94d39f52c89a None admin] RBAC: Authorizing `identity:get_project(project_id=d0fa97262e904ea29696d2d9cb8b9bc3)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:02.489492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342453bc-e378-450a-96f2-94d39f52c89a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:02.494022 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 195/377] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:02 2022] GET /identity/v3/projects/d0fa97262e904ea29696d2d9cb8b9bc3 => generated 344 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:02.498339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd97b7c-47b3-4100-804a-8a583ca4a752 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:02.498339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd97b7c-47b3-4100-804a-8a583ca4a752 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:02.498339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd97b7c-47b3-4100-804a-8a583ca4a752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:02.520883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-cdd97b7c-47b3-4100-804a-8a583ca4a752 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:02.522110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-cdd97b7c-47b3-4100-804a-8a583ca4a752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:02.629929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162b02-5a0a-41b9-ad1f-85ac34ec4637 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:02.674250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f1c0b-bab5-414e-9cd6-93e68e383204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:02.674877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f1c0b-bab5-414e-9cd6-93e68e383204 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:02.675161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f1c0b-bab5-414e-9cd6-93e68e383204 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:02.675441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f1c0b-bab5-414e-9cd6-93e68e383204 None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:02.676700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f1c0b-bab5-414e-9cd6-93e68e383204 None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:02.678268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f1c0b-bab5-414e-9cd6-93e68e383204 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:02.680383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 183/378] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:02 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:02.681186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f1c0b-bab5-414e-9cd6-93e68e383204 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:02.688467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 196/379] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:02.689174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd97b7c-47b3-4100-804a-8a583ca4a752 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:02.842785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:02.845204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:02.884737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f1c0b-bab5-414e-9cd6-93e68e383204 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:02.904405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd97b7c-47b3-4100-804a-8a583ca4a752 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:02.951383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65809a2b-fd38-40b1-a67a-7f80add1b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:02.952354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65809a2b-fd38-40b1-a67a-7f80add1b156 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:02.952848 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65809a2b-fd38-40b1-a67a-7f80add1b156 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:02.953439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65809a2b-fd38-40b1-a67a-7f80add1b156 None admin] PATH_INFO: `/v3/groups/c39e8a2c24e54f0994a4445476b199e5` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:02.954991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b528c5f-e920-44bb-87e2-10d532625ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:02.955694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b528c5f-e920-44bb-87e2-10d532625ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:02.955972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b528c5f-e920-44bb-87e2-10d532625ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:02.956253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b528c5f-e920-44bb-87e2-10d532625ac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:02.957251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b528c5f-e920-44bb-87e2-10d532625ac7 None admin] RBAC: Adding query filter params (group.id=9ac31470123d4e2bbefa0dd2b8904af0, role.id=ac5a79a4ca8d49298d455da9928e5a4f, scope.project.id=03f4d63223db43eb85dbf6a826df6875) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:02.957576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b528c5f-e920-44bb-87e2-10d532625ac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:02.959059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b528c5f-e920-44bb-87e2-10d532625ac7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:02.966086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 197/380] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 4 05:06:02 2022] GET /identity/v3/role_assignments?group.id=9ac31470123d4e2bbefa0dd2b8904af0&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=ac5a79a4ca8d49298d455da9928e5a4f => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:02.966833 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b528c5f-e920-44bb-87e2-10d532625ac7 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:02.968131 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65809a2b-fd38-40b1-a67a-7f80add1b156 None admin] RBAC: Authorizing `identity:get_group(group_id=c39e8a2c24e54f0994a4445476b199e5)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:02.971016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65809a2b-fd38-40b1-a67a-7f80add1b156 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:02.975717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 184/381] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:02 2022] GET /identity/v3/groups/c39e8a2c24e54f0994a4445476b199e5 => generated 229 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:02.983601 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65809a2b-fd38-40b1-a67a-7f80add1b156 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:03.147116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b528c5f-e920-44bb-87e2-10d532625ac7 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:03.197398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17c2cf-a84f-4e4e-925c-a1a16ab0e831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:03.198065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c2cf-a84f-4e4e-925c-a1a16ab0e831 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:03.198374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c2cf-a84f-4e4e-925c-a1a16ab0e831 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:03.198655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c2cf-a84f-4e4e-925c-a1a16ab0e831 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:03.207639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:03.208606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65809a2b-fd38-40b1-a67a-7f80add1b156 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:03.216339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17c2cf-a84f-4e4e-925c-a1a16ab0e831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-1d17c2cf-a84f-4e4e-925c-a1a16ab0e831 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:03.221618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:03.223455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:06:03.224396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:03.227071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 198/382] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:03.253028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17c2cf-a84f-4e4e-925c-a1a16ab0e831 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:03.289235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f5b4-52c7-4dce-8537-f9186a3fa00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:03.289828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f5b4-52c7-4dce-8537-f9186a3fa00d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:03.290103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f5b4-52c7-4dce-8537-f9186a3fa00d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:03.290410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f5b4-52c7-4dce-8537-f9186a3fa00d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:03.291376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2f5b4-52c7-4dce-8537-f9186a3fa00d None admin] RBAC: Adding query filter params (group.id=c39e8a2c24e54f0994a4445476b199e5, role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=d0fa97262e904ea29696d2d9cb8b9bc3) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:03.291694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2f5b4-52c7-4dce-8537-f9186a3fa00d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:03.293837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2f5b4-52c7-4dce-8537-f9186a3fa00d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:03.301275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 185/383] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 4 05:06:02 2022] GET /identity/v3/role_assignments?group.id=c39e8a2c24e54f0994a4445476b199e5&scope.project.id=d0fa97262e904ea29696d2d9cb8b9bc3&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 260 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:03.384851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17c2cf-a84f-4e4e-925c-a1a16ab0e831 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:03.425664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bfbee-5607-412d-b1b4-5163c832dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:03.426302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bfbee-5607-412d-b1b4-5163c832dea0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:03.426610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bfbee-5607-412d-b1b4-5163c832dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:03.426885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bfbee-5607-412d-b1b4-5163c832dea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:03.427630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bfbee-5607-412d-b1b4-5163c832dea0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:03.427936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bfbee-5607-412d-b1b4-5163c832dea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:03.429355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bfbee-5607-412d-b1b4-5163c832dea0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:03.440091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 199/384] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:06:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:03.448800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f5b4-52c7-4dce-8537-f9186a3fa00d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:03.457373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:03.582215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f5b4-52c7-4dce-8537-f9186a3fa00d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:03.618539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aefe61-c505-458d-b6b9-8cef469dc52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:03.619181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aefe61-c505-458d-b6b9-8cef469dc52a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:03.619475 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aefe61-c505-458d-b6b9-8cef469dc52a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:03.619742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aefe61-c505-458d-b6b9-8cef469dc52a None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:03.620909 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aefe61-c505-458d-b6b9-8cef469dc52a None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:03.623504 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aefe61-c505-458d-b6b9-8cef469dc52a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:03.625473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 186/385] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:03 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:03.633888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bfbee-5607-412d-b1b4-5163c832dea0 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:03.708176 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:03.763029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bfbee-5607-412d-b1b4-5163c832dea0 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:03.816156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e688b-4b89-4af2-b1c9-42642eafdb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:03.817156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e688b-4b89-4af2-b1c9-42642eafdb9a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:03.817606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e688b-4b89-4af2-b1c9-42642eafdb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:03.818075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e688b-4b89-4af2-b1c9-42642eafdb9a None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:03.819548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e688b-4b89-4af2-b1c9-42642eafdb9a None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:03.821157 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e688b-4b89-4af2-b1c9-42642eafdb9a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:03.823048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 200/386] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:03 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:03.829708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aefe61-c505-458d-b6b9-8cef469dc52a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:03.872484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbefc97-d830-44d2-910f-39a40e1ac55e None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:03.873805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbefc97-d830-44d2-910f-39a40e1ac55e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:03.874338 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbefc97-d830-44d2-910f-39a40e1ac55e None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:03.876475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 201/387] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:03.884099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486eaab-97bd-48a1-8781-ed6e3a2e9f2b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:03.884819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486eaab-97bd-48a1-8781-ed6e3a2e9f2b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:03.885499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486eaab-97bd-48a1-8781-ed6e3a2e9f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:03.910154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-8486eaab-97bd-48a1-8781-ed6e3a2e9f2b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:03.912241 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8486eaab-97bd-48a1-8781-ed6e3a2e9f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:03.990707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:04.039270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aefe61-c505-458d-b6b9-8cef469dc52a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:04.052870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 202/388] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:04.076651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ea131-1f4b-475d-86cc-297e83d5ac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:04.077515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ea131-1f4b-475d-86cc-297e83d5ac25 None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:04.077892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ea131-1f4b-475d-86cc-297e83d5ac25 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:04.078262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ea131-1f4b-475d-86cc-297e83d5ac25 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/groups/9ac31470123d4e2bbefa0dd2b8904af0/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:04.080433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ea131-1f4b-475d-86cc-297e83d5ac25 None admin] RBAC: Authorizing `identity:create_grant(project_id=c79dd8e7e16b41ea974aa6b292b8aec7, group_id=9ac31470123d4e2bbefa0dd2b8904af0, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:04.082011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ea131-1f4b-475d-86cc-297e83d5ac25 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:04.092650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486eaab-97bd-48a1-8781-ed6e3a2e9f2b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:04.159531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 187/389] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Aug 4 05:06:03 2022] PUT /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/groups/9ac31470123d4e2bbefa0dd2b8904af0/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:04.175519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:04.235425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486eaab-97bd-48a1-8781-ed6e3a2e9f2b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:04.287169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa960f-7462-46a6-a805-ecd4973dcee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:04.288222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa960f-7462-46a6-a805-ecd4973dcee1 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:04.288696 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa960f-7462-46a6-a805-ecd4973dcee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:04.289254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa960f-7462-46a6-a805-ecd4973dcee1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:04.307365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa960f-7462-46a6-a805-ecd4973dcee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-67aa960f-7462-46a6-a805-ecd4973dcee1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:04.313925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:04.314906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:04.315691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:04.318431 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 203/390] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:06:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:04.325228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ea131-1f4b-475d-86cc-297e83d5ac25 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:04.466778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ea131-1f4b-475d-86cc-297e83d5ac25 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:04.505924 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:04.511900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a724922-b238-4ea4-8348-528a7afc90f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:04.512781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a724922-b238-4ea4-8348-528a7afc90f5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:04.513179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a724922-b238-4ea4-8348-528a7afc90f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:04.513459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a724922-b238-4ea4-8348-528a7afc90f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:04.514195 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a724922-b238-4ea4-8348-528a7afc90f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:04.514535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a724922-b238-4ea4-8348-528a7afc90f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:04.516102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a724922-b238-4ea4-8348-528a7afc90f5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:04.526073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 188/391] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:04.532792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa960f-7462-46a6-a805-ecd4973dcee1 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:04.680125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa960f-7462-46a6-a805-ecd4973dcee1 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:04.715023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:04.741899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d640a6e-3025-4f1f-8c9f-6aa9e9f5d6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:04.742588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d640a6e-3025-4f1f-8c9f-6aa9e9f5d6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:04.742864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d640a6e-3025-4f1f-8c9f-6aa9e9f5d6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:04.743135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d640a6e-3025-4f1f-8c9f-6aa9e9f5d6b5 None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:04.745404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d640a6e-3025-4f1f-8c9f-6aa9e9f5d6b5 None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:04.747117 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d640a6e-3025-4f1f-8c9f-6aa9e9f5d6b5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:04.749205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 204/392] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:04 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:04.754787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a724922-b238-4ea4-8348-528a7afc90f5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:04.903926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a724922-b238-4ea4-8348-528a7afc90f5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:04.957482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90158be8-8dfb-4294-a68a-346ad2dda706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:04.958525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90158be8-8dfb-4294-a68a-346ad2dda706 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:04.959048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90158be8-8dfb-4294-a68a-346ad2dda706 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:04.959541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90158be8-8dfb-4294-a68a-346ad2dda706 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:04.960983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90158be8-8dfb-4294-a68a-346ad2dda706 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:04.962690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90158be8-8dfb-4294-a68a-346ad2dda706 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:04.964622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 189/393] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:04 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:04.974610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d640a6e-3025-4f1f-8c9f-6aa9e9f5d6b5 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:05.178585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d640a6e-3025-4f1f-8c9f-6aa9e9f5d6b5 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:05.243778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3925c6-56ce-434e-8bd1-b3e71c6a08a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:05.244042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95926-27dc-42ca-8dbd-e172d5d35799 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:05.244738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95926-27dc-42ca-8dbd-e172d5d35799 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:05.244738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95926-27dc-42ca-8dbd-e172d5d35799 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:05.244972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3925c6-56ce-434e-8bd1-b3e71c6a08a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:05.244972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3925c6-56ce-434e-8bd1-b3e71c6a08a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:05.244972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3925c6-56ce-434e-8bd1-b3e71c6a08a7 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/groups/9ac31470123d4e2bbefa0dd2b8904af0/roles/ac5a79a4ca8d49298d455da9928e5a4f` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:05.246019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 190/394] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:05.248028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3925c6-56ce-434e-8bd1-b3e71c6a08a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c79dd8e7e16b41ea974aa6b292b8aec7, group_id=9ac31470123d4e2bbefa0dd2b8904af0, role_id=ac5a79a4ca8d49298d455da9928e5a4f)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:05.249486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3925c6-56ce-434e-8bd1-b3e71c6a08a7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:05.257998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b744bf-e069-4611-ab0a-e6fd4911f9b7 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:05.258383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b744bf-e069-4611-ab0a-e6fd4911f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:05.258587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b744bf-e069-4611-ab0a-e6fd4911f9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:05.278583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b0b744bf-e069-4611-ab0a-e6fd4911f9b7 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:05.280177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b0b744bf-e069-4611-ab0a-e6fd4911f9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:05.336151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 205/395] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Aug 4 05:06:04 2022] PUT /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7/groups/9ac31470123d4e2bbefa0dd2b8904af0/roles/ac5a79a4ca8d49298d455da9928e5a4f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:05.352277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:05.369099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 191/396] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:05.389853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3925c6-56ce-434e-8bd1-b3e71c6a08a7 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:05.453580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:05.530819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3925c6-56ce-434e-8bd1-b3e71c6a08a7 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:05.578823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68a51b-a274-4f63-8085-c604a26608af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:05.579468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68a51b-a274-4f63-8085-c604a26608af None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:05.579760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68a51b-a274-4f63-8085-c604a26608af None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:05.580000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68a51b-a274-4f63-8085-c604a26608af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:05.596622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68a51b-a274-4f63-8085-c604a26608af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-4c68a51b-a274-4f63-8085-c604a26608af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:05.601643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:05.603328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:05.604828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 206/397] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:05.609624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b744bf-e069-4611-ab0a-e6fd4911f9b7 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:05.721489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b744bf-e069-4611-ab0a-e6fd4911f9b7 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:05.764146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4553df0-67cc-4d1a-b8ab-5aef9e9fe0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:05.764767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4553df0-67cc-4d1a-b8ab-5aef9e9fe0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:05.767215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4553df0-67cc-4d1a-b8ab-5aef9e9fe0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:05.767215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4553df0-67cc-4d1a-b8ab-5aef9e9fe0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:05.767215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4553df0-67cc-4d1a-b8ab-5aef9e9fe0f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:05.767215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4553df0-67cc-4d1a-b8ab-5aef9e9fe0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:05.767811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4553df0-67cc-4d1a-b8ab-5aef9e9fe0f7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:05.776920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 192/398] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:06:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:05.783557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68a51b-a274-4f63-8085-c604a26608af None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:05.815087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb98cb4-cf60-4b9d-86be-a5f63f339245 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:05.815409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb98cb4-cf60-4b9d-86be-a5f63f339245 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:05.815636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb98cb4-cf60-4b9d-86be-a5f63f339245 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:05.817108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 193/399] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:06:05.822080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116524d-bef4-468e-883a-b279db0350dd None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:05.822385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116524d-bef4-468e-883a-b279db0350dd None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:05.822664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116524d-bef4-468e-883a-b279db0350dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:05.843092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d116524d-bef4-468e-883a-b279db0350dd None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:05.844354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d116524d-bef4-468e-883a-b279db0350dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:05.896414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:05.900474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68a51b-a274-4f63-8085-c604a26608af None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:05.919218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:05.922433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 194/400] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:06:05.939942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5117e3-17c1-4640-b863-4e7976f73c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:05.940865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116524d-bef4-468e-883a-b279db0350dd None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:05.941201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5117e3-17c1-4640-b863-4e7976f73c8c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:05.941761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5117e3-17c1-4640-b863-4e7976f73c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:05.942226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5117e3-17c1-4640-b863-4e7976f73c8c None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:05.943619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5117e3-17c1-4640-b863-4e7976f73c8c None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:05.946616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5117e3-17c1-4640-b863-4e7976f73c8c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:05.948811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 207/401] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:05 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:05.962701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5117e3-17c1-4640-b863-4e7976f73c8c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:06.050170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116524d-bef4-468e-883a-b279db0350dd None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:06.085769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022e1b-edae-42b2-a9ae-f81c55e31ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:06.086442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022e1b-edae-42b2-a9ae-f81c55e31ecc None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:06.086721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022e1b-edae-42b2-a9ae-f81c55e31ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:06.086995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022e1b-edae-42b2-a9ae-f81c55e31ecc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:06.098453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e022e1b-edae-42b2-a9ae-f81c55e31ecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-5e022e1b-edae-42b2-a9ae-f81c55e31ecc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:06.103437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:06.104321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:06.105214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:06.109120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5117e3-17c1-4640-b863-4e7976f73c8c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:06.110038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 195/402] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:06:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:06.111301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022e1b-edae-42b2-a9ae-f81c55e31ecc None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:06.170520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:06.220236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022e1b-edae-42b2-a9ae-f81c55e31ecc None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:06.251050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb99b7-f284-4604-a8a6-7129a7c2ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:06.251711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb99b7-f284-4604-a8a6-7129a7c2ad9d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:06.251989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb99b7-f284-4604-a8a6-7129a7c2ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:06.252261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb99b7-f284-4604-a8a6-7129a7c2ad9d None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:06.256148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c73b4-f628-44dd-a36a-6d6b44bae016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:06.256905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c73b4-f628-44dd-a36a-6d6b44bae016 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:06.257199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c73b4-f628-44dd-a36a-6d6b44bae016 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:06.257479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c73b4-f628-44dd-a36a-6d6b44bae016 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:06.258205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c73b4-f628-44dd-a36a-6d6b44bae016 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:06.258589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c73b4-f628-44dd-a36a-6d6b44bae016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:06.259113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb99b7-f284-4604-a8a6-7129a7c2ad9d None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:06.260043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c73b4-f628-44dd-a36a-6d6b44bae016 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:06.260565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb99b7-f284-4604-a8a6-7129a7c2ad9d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:06.263925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 208/403] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:05 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:06.270607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb99b7-f284-4604-a8a6-7129a7c2ad9d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:06.274764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 196/404] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:06.291426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c73b4-f628-44dd-a36a-6d6b44bae016 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:06.358961 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:06.396566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb99b7-f284-4604-a8a6-7129a7c2ad9d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:06.415669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c73b4-f628-44dd-a36a-6d6b44bae016 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:06.418601 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:06.433892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e5daf-4306-4366-84f3-9e829ec8bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:06.435162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e5daf-4306-4366-84f3-9e829ec8bd44 None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:06.435661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e5daf-4306-4366-84f3-9e829ec8bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:06.435876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e5daf-4306-4366-84f3-9e829ec8bd44 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875/groups/9ac31470123d4e2bbefa0dd2b8904af0/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:06.437847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e5daf-4306-4366-84f3-9e829ec8bd44 None admin] RBAC: Authorizing `identity:create_grant(project_id=03f4d63223db43eb85dbf6a826df6875, group_id=9ac31470123d4e2bbefa0dd2b8904af0, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:06.439306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e5daf-4306-4366-84f3-9e829ec8bd44 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:06.457864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ae976-d9ce-4666-b160-78a918cafb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:06.458689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ae976-d9ce-4666-b160-78a918cafb5c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:06.459376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ae976-d9ce-4666-b160-78a918cafb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:06.459950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ae976-d9ce-4666-b160-78a918cafb5c None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:06.461268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ae976-d9ce-4666-b160-78a918cafb5c None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:06.463395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ae976-d9ce-4666-b160-78a918cafb5c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:06.466959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 197/405] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:06 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:06.471589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f893b-67cc-48e1-b9b4-164148ab4bb0 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:06.472144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f893b-67cc-48e1-b9b4-164148ab4bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:06.476510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f893b-67cc-48e1-b9b4-164148ab4bb0 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:06.478565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 198/406] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:06.480061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f893b-67cc-48e1-b9b4-164148ab4bb0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:06.599020 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 209/407] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Aug 4 05:06:06 2022] PUT /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875/groups/9ac31470123d4e2bbefa0dd2b8904af0/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:06.601855 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485bfd-41e9-49e2-924a-07147bd98422 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:06.603772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485bfd-41e9-49e2-924a-07147bd98422 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:06.604250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485bfd-41e9-49e2-924a-07147bd98422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:06.626335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f893b-67cc-48e1-b9b4-164148ab4bb0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:06.655283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-1c485bfd-41e9-49e2-924a-07147bd98422 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:06.656488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1c485bfd-41e9-49e2-924a-07147bd98422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:06.715735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa940188-3474-4dc2-973e-2d9a9eddd23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:06.716458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940188-3474-4dc2-973e-2d9a9eddd23f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:06.718078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940188-3474-4dc2-973e-2d9a9eddd23f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:06.718400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940188-3474-4dc2-973e-2d9a9eddd23f None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:06.719796 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa940188-3474-4dc2-973e-2d9a9eddd23f None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:06.721258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa940188-3474-4dc2-973e-2d9a9eddd23f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:06.725032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 199/408] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:06 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:06.732330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa940188-3474-4dc2-973e-2d9a9eddd23f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:06.818885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:06.826769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 210/409] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:06.853401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c485bfd-41e9-49e2-924a-07147bd98422 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:06.894569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa940188-3474-4dc2-973e-2d9a9eddd23f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:06.898227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:06.946557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a4732-c63b-448d-ad39-0d0cd3dfefb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:06.947700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a4732-c63b-448d-ad39-0d0cd3dfefb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:06.948043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a4732-c63b-448d-ad39-0d0cd3dfefb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:06.948388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a4732-c63b-448d-ad39-0d0cd3dfefb1 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875/groups/9ac31470123d4e2bbefa0dd2b8904af0/roles/ac5a79a4ca8d49298d455da9928e5a4f` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:06.951204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a4732-c63b-448d-ad39-0d0cd3dfefb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=03f4d63223db43eb85dbf6a826df6875, group_id=9ac31470123d4e2bbefa0dd2b8904af0, role_id=ac5a79a4ca8d49298d455da9928e5a4f)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:06.952918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a4732-c63b-448d-ad39-0d0cd3dfefb1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:07.006107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c485bfd-41e9-49e2-924a-07147bd98422 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:07.056636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 200/410] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Aug 4 05:06:06 2022] PUT /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875/groups/9ac31470123d4e2bbefa0dd2b8904af0/roles/ac5a79a4ca8d49298d455da9928e5a4f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:06:07.067706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6a218-80ec-4d05-acfd-75bacacaa956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:07.067706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6a218-80ec-4d05-acfd-75bacacaa956 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:07.067978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6a218-80ec-4d05-acfd-75bacacaa956 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:07.068258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6a218-80ec-4d05-acfd-75bacacaa956 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:07.089897 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6a218-80ec-4d05-acfd-75bacacaa956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-24e6a218-80ec-4d05-acfd-75bacacaa956 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:07.101508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:07.102992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:07.104179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 211/411] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:07.112093 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a4732-c63b-448d-ad39-0d0cd3dfefb1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:07.290722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:07.296669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a4732-c63b-448d-ad39-0d0cd3dfefb1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:07.345593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763175-b2c7-4295-acb6-7e0c021e5d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:07.346217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763175-b2c7-4295-acb6-7e0c021e5d98 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:07.346532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763175-b2c7-4295-acb6-7e0c021e5d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:07.346805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763175-b2c7-4295-acb6-7e0c021e5d98 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:07.347533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763175-b2c7-4295-acb6-7e0c021e5d98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:07.347837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763175-b2c7-4295-acb6-7e0c021e5d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:07.349210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763175-b2c7-4295-acb6-7e0c021e5d98 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:07.358587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 201/412] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:07.364230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6a218-80ec-4d05-acfd-75bacacaa956 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:07.500214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:07.508767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6a218-80ec-4d05-acfd-75bacacaa956 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:07.535090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308feb7e-9bfe-474c-ae41-152a6f92e6e4 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:07.535704 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308feb7e-9bfe-474c-ae41-152a6f92e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:07.536163 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308feb7e-9bfe-474c-ae41-152a6f92e6e4 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:07.537824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 202/413] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:07.543895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7767479-f009-474c-853a-0c53cbace551 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:07.544268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7767479-f009-474c-853a-0c53cbace551 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:07.544625 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7767479-f009-474c-853a-0c53cbace551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:07.579287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e160-0094-454a-a95d-0dd2fc4e2cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:07.580262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d7767479-f009-474c-853a-0c53cbace551 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:07.580472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e160-0094-454a-a95d-0dd2fc4e2cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:07.580940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e160-0094-454a-a95d-0dd2fc4e2cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:07.581404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e160-0094-454a-a95d-0dd2fc4e2cd1 None admin] PATH_INFO: `/v3/groups/c39e8a2c24e54f0994a4445476b199e5` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:07.581709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d7767479-f009-474c-853a-0c53cbace551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:07.587206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4e160-0094-454a-a95d-0dd2fc4e2cd1 None admin] RBAC: Authorizing `identity:get_group(group_id=c39e8a2c24e54f0994a4445476b199e5)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:07.588908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4e160-0094-454a-a95d-0dd2fc4e2cd1 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:07.592767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 212/414] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:07 2022] GET /identity/v3/groups/c39e8a2c24e54f0994a4445476b199e5 => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:07.596164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e160-0094-454a-a95d-0dd2fc4e2cd1 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:07.716317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 203/415] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:07.742652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7767479-f009-474c-853a-0c53cbace551 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:07.761109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e160-0094-454a-a95d-0dd2fc4e2cd1 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:07.828128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f46d4-01bb-431e-bfc6-37945bb8c6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:07.828780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f46d4-01bb-431e-bfc6-37945bb8c6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:07.829059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f46d4-01bb-431e-bfc6-37945bb8c6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:07.829335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f46d4-01bb-431e-bfc6-37945bb8c6a4 None admin] PATH_INFO: `/v3/projects/d0fa97262e904ea29696d2d9cb8b9bc3` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:07.830637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f46d4-01bb-431e-bfc6-37945bb8c6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=d0fa97262e904ea29696d2d9cb8b9bc3)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:07.832190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f46d4-01bb-431e-bfc6-37945bb8c6a4 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:07.838617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 213/416] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:07 2022] GET /identity/v3/projects/d0fa97262e904ea29696d2d9cb8b9bc3 => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:07.843199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f46d4-01bb-431e-bfc6-37945bb8c6a4 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:07.854995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:07.865254 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7767479-f009-474c-853a-0c53cbace551 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:07.902512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b009f37-5683-46eb-a517-a7e615e23e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:07.904097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b009f37-5683-46eb-a517-a7e615e23e94 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:07.904555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b009f37-5683-46eb-a517-a7e615e23e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:07.905097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b009f37-5683-46eb-a517-a7e615e23e94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:07.916100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:07.916711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b009f37-5683-46eb-a517-a7e615e23e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-1b009f37-5683-46eb-a517-a7e615e23e94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:07.922394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:07.929521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:07.930328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 204/417] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:07.932087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b009f37-5683-46eb-a517-a7e615e23e94 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:08.021325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f46d4-01bb-431e-bfc6-37945bb8c6a4 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:08.059469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc9ecb-93ae-4f4d-9513-b0ae4c4bf0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:08.060860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9ecb-93ae-4f4d-9513-b0ae4c4bf0af None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:08.061287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9ecb-93ae-4f4d-9513-b0ae4c4bf0af None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:08.061708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9ecb-93ae-4f4d-9513-b0ae4c4bf0af None admin] PATH_INFO: `/v3/projects/d0fa97262e904ea29696d2d9cb8b9bc3/groups/c39e8a2c24e54f0994a4445476b199e5/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:08.064928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc9ecb-93ae-4f4d-9513-b0ae4c4bf0af None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fa97262e904ea29696d2d9cb8b9bc3, group_id=c39e8a2c24e54f0994a4445476b199e5, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:08.066582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc9ecb-93ae-4f4d-9513-b0ae4c4bf0af None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:08.150405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 214/418] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Aug 4 05:06:07 2022] PUT /identity/v3/projects/d0fa97262e904ea29696d2d9cb8b9bc3/groups/c39e8a2c24e54f0994a4445476b199e5/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:08.151979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b009f37-5683-46eb-a517-a7e615e23e94 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:08.192610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dc5b3-71ef-4cc8-bb92-32f2ff0049e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:08.193236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dc5b3-71ef-4cc8-bb92-32f2ff0049e1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:08.193597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dc5b3-71ef-4cc8-bb92-32f2ff0049e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:08.193872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dc5b3-71ef-4cc8-bb92-32f2ff0049e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:08.194723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dc5b3-71ef-4cc8-bb92-32f2ff0049e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:08.195031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dc5b3-71ef-4cc8-bb92-32f2ff0049e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:08.196435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dc5b3-71ef-4cc8-bb92-32f2ff0049e1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:08.207203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 205/419] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:06:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:08.213246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc9ecb-93ae-4f4d-9513-b0ae4c4bf0af None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:08.310895 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:08.332290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc9ecb-93ae-4f4d-9513-b0ae4c4bf0af None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:08.378651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6694b5-a406-408d-98f5-b27c31a8b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:08.379398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6694b5-a406-408d-98f5-b27c31a8b362 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:08.379680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6694b5-a406-408d-98f5-b27c31a8b362 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:08.379954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6694b5-a406-408d-98f5-b27c31a8b362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:08.396578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3128fcd-98e3-42d4-aa6c-7fd92bc02093 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:08.397081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3128fcd-98e3-42d4-aa6c-7fd92bc02093 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:08.397185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3128fcd-98e3-42d4-aa6c-7fd92bc02093 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:08.402215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 206/420] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:06:08.403905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcc26-da42-4681-a7a1-1554b7ede9b1 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:08.404188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcc26-da42-4681-a7a1-1554b7ede9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:08.404460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcc26-da42-4681-a7a1-1554b7ede9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:08.425776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-5a9fcc26-da42-4681-a7a1-1554b7ede9b1 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:08.426985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5a9fcc26-da42-4681-a7a1-1554b7ede9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:08.439760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:08.468270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6694b5-a406-408d-98f5-b27c31a8b362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:08.469925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6694b5-a406-408d-98f5-b27c31a8b362 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:08.533564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 207/421] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:08.571897 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fcc26-da42-4681-a7a1-1554b7ede9b1 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:08.577053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:08.590889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 215/422] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:08.596608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6694b5-a406-408d-98f5-b27c31a8b362 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:08.700168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6694b5-a406-408d-98f5-b27c31a8b362 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:08.736957 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5317f90-f503-40d2-97dc-347a7723c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:08.737604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317f90-f503-40d2-97dc-347a7723c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:08.737886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317f90-f503-40d2-97dc-347a7723c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:08.738164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317f90-f503-40d2-97dc-347a7723c3b1 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:08.739905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5317f90-f503-40d2-97dc-347a7723c3b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:08.741356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5317f90-f503-40d2-97dc-347a7723c3b1 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:08.743615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 216/423] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:08 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:08.749455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5317f90-f503-40d2-97dc-347a7723c3b1 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:08.828651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:08.842716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fcc26-da42-4681-a7a1-1554b7ede9b1 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:08.867032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5317f90-f503-40d2-97dc-347a7723c3b1 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:08.909554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79d793-efd2-4ef1-bf81-4f6c6a117c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:08.910361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79d793-efd2-4ef1-bf81-4f6c6a117c6a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:08.910646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79d793-efd2-4ef1-bf81-4f6c6a117c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:08.910919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79d793-efd2-4ef1-bf81-4f6c6a117c6a None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:08.912085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79d793-efd2-4ef1-bf81-4f6c6a117c6a None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:08.913647 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79d793-efd2-4ef1-bf81-4f6c6a117c6a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:08.915639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 217/424] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:08 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:08.918110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b229e-129d-45ac-bde0-0da33dae4127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:08.919435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b229e-129d-45ac-bde0-0da33dae4127 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:08.919916 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b229e-129d-45ac-bde0-0da33dae4127 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:08.920387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b229e-129d-45ac-bde0-0da33dae4127 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:08.925090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79d793-efd2-4ef1-bf81-4f6c6a117c6a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:08.962970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b229e-129d-45ac-bde0-0da33dae4127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-6c3b229e-129d-45ac-bde0-0da33dae4127 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:08.968378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:08.969261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:08.970063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 208/425] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:06:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:08.975505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b229e-129d-45ac-bde0-0da33dae4127 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:08.980782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:09.048382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79d793-efd2-4ef1-bf81-4f6c6a117c6a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:09.082774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:09.095326 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa7144-faa5-43cc-8c62-aa38c1f4dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:09.096301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7144-faa5-43cc-8c62-aa38c1f4dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:09.097960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7144-faa5-43cc-8c62-aa38c1f4dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:09.098465 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7144-faa5-43cc-8c62-aa38c1f4dbb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:09.100709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b229e-129d-45ac-bde0-0da33dae4127 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:09.101707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa7144-faa5-43cc-8c62-aa38c1f4dbb9 None admin] RBAC: Adding query filter params (group.id=9ac31470123d4e2bbefa0dd2b8904af0, role.id=135a36507984447394cee2c2924414bb, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:09.102181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa7144-faa5-43cc-8c62-aa38c1f4dbb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:09.105565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa7144-faa5-43cc-8c62-aa38c1f4dbb9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:09.117434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 218/426] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 4 05:06:08 2022] GET /identity/v3/role_assignments?group.id=9ac31470123d4e2bbefa0dd2b8904af0&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=135a36507984447394cee2c2924414bb => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:09.178400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107e4a3-28b5-45fa-9d78-20130313b55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:09.178400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107e4a3-28b5-45fa-9d78-20130313b55d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:09.178400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107e4a3-28b5-45fa-9d78-20130313b55d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:09.178400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107e4a3-28b5-45fa-9d78-20130313b55d None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:09.178827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107e4a3-28b5-45fa-9d78-20130313b55d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:09.178827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107e4a3-28b5-45fa-9d78-20130313b55d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:09.178827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107e4a3-28b5-45fa-9d78-20130313b55d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:09.187735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 209/427] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:09.193478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa7144-faa5-43cc-8c62-aa38c1f4dbb9 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:09.242714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6390552-0292-47ab-bd3b-18d5dda00dfe None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:09.243042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6390552-0292-47ab-bd3b-18d5dda00dfe None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:09.243305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6390552-0292-47ab-bd3b-18d5dda00dfe None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:09.245038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 210/428] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:06:09.251587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fb5ac-8455-4446-9d05-0affb32a0e05 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:09.252018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fb5ac-8455-4446-9d05-0affb32a0e05 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:09.252310 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fb5ac-8455-4446-9d05-0affb32a0e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:09.286412 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-f55fb5ac-8455-4446-9d05-0affb32a0e05 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:09.287666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f55fb5ac-8455-4446-9d05-0affb32a0e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:09.383957 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa7144-faa5-43cc-8c62-aa38c1f4dbb9 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:09.389895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:09.398423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 211/429] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:09.424618 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fb5ac-8455-4446-9d05-0affb32a0e05 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:09.437227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceba3a4-6c12-4c4c-b56c-42b4776950b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:09.437874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceba3a4-6c12-4c4c-b56c-42b4776950b5 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:09.438158 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceba3a4-6c12-4c4c-b56c-42b4776950b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:09.438481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceba3a4-6c12-4c4c-b56c-42b4776950b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:09.518153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:09.535402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceba3a4-6c12-4c4c-b56c-42b4776950b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:09.537183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceba3a4-6c12-4c4c-b56c-42b4776950b5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:09.546333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fb5ac-8455-4446-9d05-0affb32a0e05 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:09.592567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b626184-8f7e-4a2c-a462-0bd15831ad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:09.593316 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626184-8f7e-4a2c-a462-0bd15831ad72 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:09.593663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626184-8f7e-4a2c-a462-0bd15831ad72 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:09.594007 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626184-8f7e-4a2c-a462-0bd15831ad72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:09.608945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b626184-8f7e-4a2c-a462-0bd15831ad72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-0b626184-8f7e-4a2c-a462-0bd15831ad72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:09.615352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:09.616258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:09.617062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 212/430] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:09.617744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41dd55-7b70-4bb1-ae02-0ce2bd43daf0 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:09.618431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41dd55-7b70-4bb1-ae02-0ce2bd43daf0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:09.618431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41dd55-7b70-4bb1-ae02-0ce2bd43daf0 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:09.624547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 213/431] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:09.625674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7343-c6aa-4b1d-b473-2b76ce1e2a4f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:09.625962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7343-c6aa-4b1d-b473-2b76ce1e2a4f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:09.626241 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7343-c6aa-4b1d-b473-2b76ce1e2a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:09.648722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8f7c7343-c6aa-4b1d-b473-2b76ce1e2a4f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:09.649998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8f7c7343-c6aa-4b1d-b473-2b76ce1e2a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:09.672840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 219/432] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:09.673938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceba3a4-6c12-4c4c-b56c-42b4776950b5 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:09.722225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:09.738020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 214/433] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:06:09.738795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c7343-c6aa-4b1d-b473-2b76ce1e2a4f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:09.794123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:09.812964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceba3a4-6c12-4c4c-b56c-42b4776950b5 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:09.864106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af634d55-8f10-4d3e-b627-762efaa2adf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:09.864820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634d55-8f10-4d3e-b627-762efaa2adf4 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:09.865097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634d55-8f10-4d3e-b627-762efaa2adf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:09.865363 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634d55-8f10-4d3e-b627-762efaa2adf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:09.866130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af634d55-8f10-4d3e-b627-762efaa2adf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:09.866650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af634d55-8f10-4d3e-b627-762efaa2adf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:09.867825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af634d55-8f10-4d3e-b627-762efaa2adf4 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:09.869308 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c7343-c6aa-4b1d-b473-2b76ce1e2a4f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:09.877422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 220/434] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:06:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:09.877958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af634d55-8f10-4d3e-b627-762efaa2adf4 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:09.911397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b81a-379d-4dfd-ac0b-bbe3878cfc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:09.911959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b81a-379d-4dfd-ac0b-bbe3878cfc31 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:09.912239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b81a-379d-4dfd-ac0b-bbe3878cfc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:09.912525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b81a-379d-4dfd-ac0b-bbe3878cfc31 None admin] PATH_INFO: `/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:09.913681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2b81a-379d-4dfd-ac0b-bbe3878cfc31 None admin] RBAC: Authorizing `identity:get_project(project_id=c79dd8e7e16b41ea974aa6b292b8aec7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:09.915154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2b81a-379d-4dfd-ac0b-bbe3878cfc31 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:09.916914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 215/435] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:09 2022] GET /identity/v3/projects/c79dd8e7e16b41ea974aa6b292b8aec7 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:09.917664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b81a-379d-4dfd-ac0b-bbe3878cfc31 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:09.978453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:09.996055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af634d55-8f10-4d3e-b627-762efaa2adf4 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:10.026940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b81a-379d-4dfd-ac0b-bbe3878cfc31 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:10.036447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f22ef-d9df-490a-b7af-23d93f8c8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:10.037280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f22ef-d9df-490a-b7af-23d93f8c8a92 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.037441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f22ef-d9df-490a-b7af-23d93f8c8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.037719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f22ef-d9df-490a-b7af-23d93f8c8a92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.050425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f22ef-d9df-490a-b7af-23d93f8c8a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-441f22ef-d9df-490a-b7af-23d93f8c8a92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:10.057619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:10.058746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:10.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 221/436] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:06:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:10.060576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f22ef-d9df-490a-b7af-23d93f8c8a92 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:10.069015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d4a3-268e-4b25-9679-1a8dc7227d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:10.069641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d4a3-268e-4b25-9679-1a8dc7227d4b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.069926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d4a3-268e-4b25-9679-1a8dc7227d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.070242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d4a3-268e-4b25-9679-1a8dc7227d4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.075812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:10.145159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3d4a3-268e-4b25-9679-1a8dc7227d4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:10.147521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3d4a3-268e-4b25-9679-1a8dc7227d4b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:10.173984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f22ef-d9df-490a-b7af-23d93f8c8a92 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:10.211480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da146ce-b98d-4287-8b36-d57d44ba1007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:10.212645 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da146ce-b98d-4287-8b36-d57d44ba1007 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.212930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da146ce-b98d-4287-8b36-d57d44ba1007 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.213357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da146ce-b98d-4287-8b36-d57d44ba1007 None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.214594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da146ce-b98d-4287-8b36-d57d44ba1007 None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:10.215049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:10.216789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da146ce-b98d-4287-8b36-d57d44ba1007 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:10.218410 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 222/437] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:10 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:10.219189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da146ce-b98d-4287-8b36-d57d44ba1007 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:10.275465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 216/438] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:10.275465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d4a3-268e-4b25-9679-1a8dc7227d4b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:10.312636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:10.335175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da146ce-b98d-4287-8b36-d57d44ba1007 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:10.377250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9705e-315c-4a46-8c79-ccd37d488f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:10.378733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9705e-315c-4a46-8c79-ccd37d488f2f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.379245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9705e-315c-4a46-8c79-ccd37d488f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.379701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9705e-315c-4a46-8c79-ccd37d488f2f None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.380376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d4a3-268e-4b25-9679-1a8dc7227d4b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:10.380868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9705e-315c-4a46-8c79-ccd37d488f2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:10.381351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9705e-315c-4a46-8c79-ccd37d488f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:10.384002 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9705e-315c-4a46-8c79-ccd37d488f2f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:10.399625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 223/439] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:10.399625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9705e-315c-4a46-8c79-ccd37d488f2f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:10.420957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b9f52-a973-495c-90b3-ee28fbee79a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:10.421531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b9f52-a973-495c-90b3-ee28fbee79a5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.421855 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b9f52-a973-495c-90b3-ee28fbee79a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.422435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b9f52-a973-495c-90b3-ee28fbee79a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.423232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b9f52-a973-495c-90b3-ee28fbee79a5 None admin] RBAC: Adding query filter params (group.id=9ac31470123d4e2bbefa0dd2b8904af0, role.id=ac5a79a4ca8d49298d455da9928e5a4f, scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:10.423546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b9f52-a973-495c-90b3-ee28fbee79a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:10.424983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b9f52-a973-495c-90b3-ee28fbee79a5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:10.430937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 217/440] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 4 05:06:10 2022] GET /identity/v3/role_assignments?group.id=9ac31470123d4e2bbefa0dd2b8904af0&scope.project.id=c79dd8e7e16b41ea974aa6b292b8aec7&role.id=ac5a79a4ca8d49298d455da9928e5a4f => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:10.431751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b9f52-a973-495c-90b3-ee28fbee79a5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:10.457257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:10.535668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9705e-315c-4a46-8c79-ccd37d488f2f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:10.559535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b9f52-a973-495c-90b3-ee28fbee79a5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:10.576069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debf70c-127b-4aa5-bf2c-941cfc3b2392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:10.576881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debf70c-127b-4aa5-bf2c-941cfc3b2392 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.577309 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debf70c-127b-4aa5-bf2c-941cfc3b2392 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.577696 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debf70c-127b-4aa5-bf2c-941cfc3b2392 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.579209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debf70c-127b-4aa5-bf2c-941cfc3b2392 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:10.581654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debf70c-127b-4aa5-bf2c-941cfc3b2392 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:10.586463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 224/441] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:10 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:10.590772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debf70c-127b-4aa5-bf2c-941cfc3b2392 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:10.609491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:10.613885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65ea0f-2789-4ddc-977b-6c96a6d1b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:10.614902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65ea0f-2789-4ddc-977b-6c96a6d1b09c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.615325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65ea0f-2789-4ddc-977b-6c96a6d1b09c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.615918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65ea0f-2789-4ddc-977b-6c96a6d1b09c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.716198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65ea0f-2789-4ddc-977b-6c96a6d1b09c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:10.716198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65ea0f-2789-4ddc-977b-6c96a6d1b09c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:10.716446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debf70c-127b-4aa5-bf2c-941cfc3b2392 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:10.737179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:10.754977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3911c1-c8e7-4b8e-b59c-ea9592a641ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:10.755615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3911c1-c8e7-4b8e-b59c-ea9592a641ab None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.755891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3911c1-c8e7-4b8e-b59c-ea9592a641ab None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.756169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3911c1-c8e7-4b8e-b59c-ea9592a641ab None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.758362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3911c1-c8e7-4b8e-b59c-ea9592a641ab None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:10.761283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3911c1-c8e7-4b8e-b59c-ea9592a641ab None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:10.761283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 225/442] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:10 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:10.763113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee041607-d680-471a-9588-404868349517 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.763799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee041607-d680-471a-9588-404868349517 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.763799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee041607-d680-471a-9588-404868349517 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.765154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 226/443] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:10.769086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee041607-d680-471a-9588-404868349517 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:10.842073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 218/444] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:10.842259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af96e1-c2fc-445e-8c9e-fd934bcc3715 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.843134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af96e1-c2fc-445e-8c9e-fd934bcc3715 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.843416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af96e1-c2fc-445e-8c9e-fd934bcc3715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.861745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:10.861955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-21af96e1-c2fc-445e-8c9e-fd934bcc3715 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:10.863268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-21af96e1-c2fc-445e-8c9e-fd934bcc3715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:10.885634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee041607-d680-471a-9588-404868349517 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:10.920431 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02945aa3-3130-46d4-811f-8b4bcb24c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:10.921033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945aa3-3130-46d4-811f-8b4bcb24c310 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:10.921307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945aa3-3130-46d4-811f-8b4bcb24c310 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:10.921577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945aa3-3130-46d4-811f-8b4bcb24c310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:10.922659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945aa3-3130-46d4-811f-8b4bcb24c310 None admin] RBAC: Adding query filter params (group.id=9ac31470123d4e2bbefa0dd2b8904af0, role.id=135a36507984447394cee2c2924414bb, scope.project.id=03f4d63223db43eb85dbf6a826df6875) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:10.922964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945aa3-3130-46d4-811f-8b4bcb24c310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:10.924391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945aa3-3130-46d4-811f-8b4bcb24c310 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:10.946342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 227/445] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 4 05:06:10 2022] GET /identity/v3/role_assignments?group.id=9ac31470123d4e2bbefa0dd2b8904af0&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=135a36507984447394cee2c2924414bb => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:10.946342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02945aa3-3130-46d4-811f-8b4bcb24c310 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:10.946624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 219/446] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:10.956325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af96e1-c2fc-445e-8c9e-fd934bcc3715 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:11.014666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:11.053611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02945aa3-3130-46d4-811f-8b4bcb24c310 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:11.076945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af96e1-c2fc-445e-8c9e-fd934bcc3715 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:11.098193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557adf9d-da39-4ac1-a676-b8dee6df2e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:11.098886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557adf9d-da39-4ac1-a676-b8dee6df2e02 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:11.099971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557adf9d-da39-4ac1-a676-b8dee6df2e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:11.099971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557adf9d-da39-4ac1-a676-b8dee6df2e02 None admin] PATH_INFO: `/v3/projects/03f4d63223db43eb85dbf6a826df6875` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:11.101275 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557adf9d-da39-4ac1-a676-b8dee6df2e02 None admin] RBAC: Authorizing `identity:get_project(project_id=03f4d63223db43eb85dbf6a826df6875)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:11.102130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557adf9d-da39-4ac1-a676-b8dee6df2e02 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:11.103831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 228/447] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:10 2022] GET /identity/v3/projects/03f4d63223db43eb85dbf6a826df6875 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:11.109668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557adf9d-da39-4ac1-a676-b8dee6df2e02 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:11.119910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97f50b-e0c5-4222-ba06-9623ea22ae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:11.120562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97f50b-e0c5-4222-ba06-9623ea22ae30 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:11.121857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97f50b-e0c5-4222-ba06-9623ea22ae30 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:11.122378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97f50b-e0c5-4222-ba06-9623ea22ae30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:11.124092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:11.136097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97f50b-e0c5-4222-ba06-9623ea22ae30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-bd97f50b-e0c5-4222-ba06-9623ea22ae30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:11.145837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:11.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:11.147561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 220/448] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:11.150251 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97f50b-e0c5-4222-ba06-9623ea22ae30 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:11.242725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557adf9d-da39-4ac1-a676-b8dee6df2e02 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:11.279712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97f50b-e0c5-4222-ba06-9623ea22ae30 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:11.283852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85645edd-03d0-495c-a16b-d043cf97de82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:11.284498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85645edd-03d0-495c-a16b-d043cf97de82 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:11.284777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85645edd-03d0-495c-a16b-d043cf97de82 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:11.285050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85645edd-03d0-495c-a16b-d043cf97de82 None admin] PATH_INFO: `/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:11.286221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85645edd-03d0-495c-a16b-d043cf97de82 None admin] RBAC: Authorizing `identity:get_group(group_id=9ac31470123d4e2bbefa0dd2b8904af0)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:11.287689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85645edd-03d0-495c-a16b-d043cf97de82 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:11.289550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:11.289668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 229/449] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:11 2022] GET /identity/v3/groups/9ac31470123d4e2bbefa0dd2b8904af0 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:11.297246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85645edd-03d0-495c-a16b-d043cf97de82 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:11.323566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0769cfe-051a-40f5-98a7-3f359b15adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:11.324183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769cfe-051a-40f5-98a7-3f359b15adf2 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:11.325012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769cfe-051a-40f5-98a7-3f359b15adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:11.325296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769cfe-051a-40f5-98a7-3f359b15adf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:11.326019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0769cfe-051a-40f5-98a7-3f359b15adf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:11.326380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0769cfe-051a-40f5-98a7-3f359b15adf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:11.327878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0769cfe-051a-40f5-98a7-3f359b15adf2 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:11.336524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 221/450] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:11.342508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0769cfe-051a-40f5-98a7-3f359b15adf2 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:11.379643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:11.403220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85645edd-03d0-495c-a16b-d043cf97de82 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:11.438390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142518a-8332-4238-8377-6920af0ba136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:11.438998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142518a-8332-4238-8377-6920af0ba136 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:11.439277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142518a-8332-4238-8377-6920af0ba136 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:11.439554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142518a-8332-4238-8377-6920af0ba136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:11.440339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142518a-8332-4238-8377-6920af0ba136 None admin] RBAC: Adding query filter params (group.id=9ac31470123d4e2bbefa0dd2b8904af0, role.id=ac5a79a4ca8d49298d455da9928e5a4f, scope.project.id=03f4d63223db43eb85dbf6a826df6875) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:11.440651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142518a-8332-4238-8377-6920af0ba136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:11.442074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142518a-8332-4238-8377-6920af0ba136 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:11.443185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0769cfe-051a-40f5-98a7-3f359b15adf2 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:11.447793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 230/451] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 4 05:06:11 2022] GET /identity/v3/role_assignments?group.id=9ac31470123d4e2bbefa0dd2b8904af0&scope.project.id=03f4d63223db43eb85dbf6a826df6875&role.id=ac5a79a4ca8d49298d455da9928e5a4f => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:11.487378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8967c-c230-45f1-9cbe-bb029d9c148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:11.488008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8967c-c230-45f1-9cbe-bb029d9c148b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:11.488280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8967c-c230-45f1-9cbe-bb029d9c148b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:11.488547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8967c-c230-45f1-9cbe-bb029d9c148b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:11.531845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:11.564998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8967c-c230-45f1-9cbe-bb029d9c148b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:11.566520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8967c-c230-45f1-9cbe-bb029d9c148b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:11.670739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 222/452] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 05:06:11.677003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142518a-8332-4238-8377-6920af0ba136 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:11.781026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142518a-8332-4238-8377-6920af0ba136 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:11.815281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d90a1-f176-4b5b-b370-1f7f303d5d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:11.815825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d90a1-f176-4b5b-b370-1f7f303d5d14 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:11.816099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d90a1-f176-4b5b-b370-1f7f303d5d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:11.816366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d90a1-f176-4b5b-b370-1f7f303d5d14 None admin] PATH_INFO: `/v3/projects/d0fa97262e904ea29696d2d9cb8b9bc3` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:11.817503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d90a1-f176-4b5b-b370-1f7f303d5d14 None admin] RBAC: Authorizing `identity:get_project(project_id=d0fa97262e904ea29696d2d9cb8b9bc3)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:11.818953 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d90a1-f176-4b5b-b370-1f7f303d5d14 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:11.820587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 231/453] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:06:11 2022] GET /identity/v3/projects/d0fa97262e904ea29696d2d9cb8b9bc3 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:11.826968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8967c-c230-45f1-9cbe-bb029d9c148b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:11.893228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:11.924684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8967c-c230-45f1-9cbe-bb029d9c148b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:11.957383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af2ea2-0daf-4a0d-b329-eea43001fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:11.958011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af2ea2-0daf-4a0d-b329-eea43001fa48 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:11.958289 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af2ea2-0daf-4a0d-b329-eea43001fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:11.958601 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af2ea2-0daf-4a0d-b329-eea43001fa48 None admin] PATH_INFO: `/v3/groups/c39e8a2c24e54f0994a4445476b199e5` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:11.959733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af2ea2-0daf-4a0d-b329-eea43001fa48 None admin] RBAC: Authorizing `identity:get_group(group_id=c39e8a2c24e54f0994a4445476b199e5)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:11.961161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af2ea2-0daf-4a0d-b329-eea43001fa48 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:11.962772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 223/454] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Aug 4 05:06:11 2022] GET /identity/v3/groups/c39e8a2c24e54f0994a4445476b199e5 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:11.969193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d90a1-f176-4b5b-b370-1f7f303d5d14 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:11.980296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:12.068927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d90a1-f176-4b5b-b370-1f7f303d5d14 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:12.101200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108f4c3-e923-4d80-a81a-482d680ae637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:12.101798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108f4c3-e923-4d80-a81a-482d680ae637 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:12.102074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108f4c3-e923-4d80-a81a-482d680ae637 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:12.102367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108f4c3-e923-4d80-a81a-482d680ae637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:12.103252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108f4c3-e923-4d80-a81a-482d680ae637 None admin] RBAC: Adding query filter params (group.id=c39e8a2c24e54f0994a4445476b199e5, role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=d0fa97262e904ea29696d2d9cb8b9bc3) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:12.103565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108f4c3-e923-4d80-a81a-482d680ae637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:12.104993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108f4c3-e923-4d80-a81a-482d680ae637 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:12.111433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 232/455] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Aug 4 05:06:11 2022] GET /identity/v3/role_assignments?group.id=c39e8a2c24e54f0994a4445476b199e5&scope.project.id=d0fa97262e904ea29696d2d9cb8b9bc3&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:14.625024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c30b1-388a-4a6a-9779-19fbda0df49b None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:14.625530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c30b1-388a-4a6a-9779-19fbda0df49b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:14.625802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c30b1-388a-4a6a-9779-19fbda0df49b None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:14.627334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 224/456] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:14.632515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03581f8f-80c0-4113-a0e7-6409a3ed09ee None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:14.633327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03581f8f-80c0-4113-a0e7-6409a3ed09ee None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:14.633807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03581f8f-80c0-4113-a0e7-6409a3ed09ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:14.657885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-03581f8f-80c0-4113-a0e7-6409a3ed09ee None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:14.659449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-03581f8f-80c0-4113-a0e7-6409a3ed09ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:14.746526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 233/457] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:14.794048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c30b1-388a-4a6a-9779-19fbda0df49b None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:14.912901 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c30b1-388a-4a6a-9779-19fbda0df49b None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:14.948619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192d6be-7914-446e-ab2d-022ce1d910bd None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:14.948987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192d6be-7914-446e-ab2d-022ce1d910bd None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:14.949180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192d6be-7914-446e-ab2d-022ce1d910bd None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:14.949869 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f1c54-e7ef-422e-973b-14399f36cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:14.950568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1c54-e7ef-422e-973b-14399f36cab5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:14.950877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1c54-e7ef-422e-973b-14399f36cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:14.951188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1c54-e7ef-422e-973b-14399f36cab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:14.952483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 234/458] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:14.954083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e941c7-ea69-4d44-9f08-06dbffa89f77 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:14.954685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e941c7-ea69-4d44-9f08-06dbffa89f77 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:14.955156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e941c7-ea69-4d44-9f08-06dbffa89f77 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:14.957347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 235/459] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:14.958967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5bc35-fb4e-48e2-bbed-22a2e4b48232 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:14.959474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5bc35-fb4e-48e2-bbed-22a2e4b48232 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:14.959843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:14.960148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5bc35-fb4e-48e2-bbed-22a2e4b48232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:14.967513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f1c54-e7ef-422e-973b-14399f36cab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:14.969086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:14.969901 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f1c54-e7ef-422e-973b-14399f36cab5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:14.984849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-8ab5bc35-fb4e-48e2-bbed-22a2e4b48232 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:14.986427 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8ab5bc35-fb4e-48e2-bbed-22a2e4b48232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-936f1c54-e7ef-422e-973b-14399f36cab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:14.987044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:14.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:14.990857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:14.990857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:14.990857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:14.990857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:14.990857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 225/460] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:14.990857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f7c43-1c66-4252-ac8d-81cb70af7d81 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:14.990857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f7c43-1c66-4252-ac8d-81cb70af7d81 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:14.990857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f7c43-1c66-4252-ac8d-81cb70af7d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.009457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ed8f7c43-1c66-4252-ac8d-81cb70af7d81 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:15.012073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ed8f7c43-1c66-4252-ac8d-81cb70af7d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:15.077565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 236/461] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:15.078864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5bc35-fb4e-48e2-bbed-22a2e4b48232 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:15.101285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 226/462] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:15.130802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f7c43-1c66-4252-ac8d-81cb70af7d81 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:15.194534 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5bc35-fb4e-48e2-bbed-22a2e4b48232 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:15.227754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:15.233617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51d4fb-822c-4ea4-bce8-2d56c4ae5dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:15.234237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51d4fb-822c-4ea4-bce8-2d56c4ae5dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:15.234548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51d4fb-822c-4ea4-bce8-2d56c4ae5dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:15.234825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51d4fb-822c-4ea4-bce8-2d56c4ae5dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.235753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51d4fb-822c-4ea4-bce8-2d56c4ae5dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:15.236014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51d4fb-822c-4ea4-bce8-2d56c4ae5dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:15.237387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51d4fb-822c-4ea4-bce8-2d56c4ae5dd5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:15.254616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 237/463] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:15.254616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51d4fb-822c-4ea4-bce8-2d56c4ae5dd5 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:15.260692 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f7c43-1c66-4252-ac8d-81cb70af7d81 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:15.284596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:15.301445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a09e59-8349-4a81-b803-ef6c4e25a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:15.302569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a09e59-8349-4a81-b803-ef6c4e25a0ac None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:15.303095 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a09e59-8349-4a81-b803-ef6c4e25a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:15.303502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a09e59-8349-4a81-b803-ef6c4e25a0ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.315561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a09e59-8349-4a81-b803-ef6c4e25a0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:15.317533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a09e59-8349-4a81-b803-ef6c4e25a0ac None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-f7a09e59-8349-4a81-b803-ef6c4e25a0ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:15.334660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:15.335761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:15.336719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:15.336719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:15.336719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:15.336719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:15.342726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 227/464] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:15.343823 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a09e59-8349-4a81-b803-ef6c4e25a0ac None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:15.361688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51d4fb-822c-4ea4-bce8-2d56c4ae5dd5 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:15.397826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3b3f8-cb9a-4831-bb03-1445a9f5d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:15.398533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b3f8-cb9a-4831-bb03-1445a9f5d269 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:15.398794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b3f8-cb9a-4831-bb03-1445a9f5d269 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:15.399069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b3f8-cb9a-4831-bb03-1445a9f5d269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.410663 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3b3f8-cb9a-4831-bb03-1445a9f5d269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:15.412121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3b3f8-cb9a-4831-bb03-1445a9f5d269 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-62a3b3f8-cb9a-4831-bb03-1445a9f5d269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:15.428378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:15.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:15.430508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:15.430508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:15.430508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:15.430508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:15.430508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 238/465] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:15.430788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3b3f8-cb9a-4831-bb03-1445a9f5d269 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:15.468563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a09e59-8349-4a81-b803-ef6c4e25a0ac None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:15.480209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:15.507068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d8dc2-0764-4533-824e-bfae89fab19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:15.507923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d8dc2-0764-4533-824e-bfae89fab19c None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:15.508204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d8dc2-0764-4533-824e-bfae89fab19c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:15.508479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d8dc2-0764-4533-824e-bfae89fab19c None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.509165 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d8dc2-0764-4533-824e-bfae89fab19c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:15.511356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d8dc2-0764-4533-824e-bfae89fab19c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:15.541871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3b3f8-cb9a-4831-bb03-1445a9f5d269 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:15.575535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4191db3-6165-4953-9050-c08ca73b4923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:15.576191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191db3-6165-4953-9050-c08ca73b4923 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:15.576466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191db3-6165-4953-9050-c08ca73b4923 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:15.576736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191db3-6165-4953-9050-c08ca73b4923 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.577414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4191db3-6165-4953-9050-c08ca73b4923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:15.577717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4191db3-6165-4953-9050-c08ca73b4923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:15.579114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4191db3-6165-4953-9050-c08ca73b4923 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:15.592367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 239/466] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:15.594143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4191db3-6165-4953-9050-c08ca73b4923 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:15.631742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 228/467] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:06:15 2022] POST /identity/v3/users => generated 246 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:15.633769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461582ac-5540-431a-85ff-b59dabc67ec9 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:15.634569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461582ac-5540-431a-85ff-b59dabc67ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:15.635075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461582ac-5540-431a-85ff-b59dabc67ec9 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.641597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 229/468] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:15.641597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461582ac-5540-431a-85ff-b59dabc67ec9 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:15.682121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:15.719998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4191db3-6165-4953-9050-c08ca73b4923 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:15.724841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:15.770450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fb40d-6685-4b3a-8f40-4d2cb775e342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:15.771081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fb40d-6685-4b3a-8f40-4d2cb775e342 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:15.771358 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fb40d-6685-4b3a-8f40-4d2cb775e342 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:15.771628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fb40d-6685-4b3a-8f40-4d2cb775e342 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.772323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fb40d-6685-4b3a-8f40-4d2cb775e342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:15.772634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fb40d-6685-4b3a-8f40-4d2cb775e342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:15.774798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fb40d-6685-4b3a-8f40-4d2cb775e342 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:15.789880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461582ac-5540-431a-85ff-b59dabc67ec9 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:15.790941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 240/469] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:15.797568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d21f6-6879-4044-ad34-2ac6bd343c6e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:15.800504 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d21f6-6879-4044-ad34-2ac6bd343c6e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:15.801126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d21f6-6879-4044-ad34-2ac6bd343c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.826189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-1d2d21f6-6879-4044-ad34-2ac6bd343c6e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:15.827763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1d2d21f6-6879-4044-ad34-2ac6bd343c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:15.844615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb23090-bc18-466e-97b9-d7e88dcd26b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:15.845619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb23090-bc18-466e-97b9-d7e88dcd26b6 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:15.845910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb23090-bc18-466e-97b9-d7e88dcd26b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:15.846197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb23090-bc18-466e-97b9-d7e88dcd26b6 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.847004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb23090-bc18-466e-97b9-d7e88dcd26b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:15.849279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb23090-bc18-466e-97b9-d7e88dcd26b6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:15.909591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 241/470] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:15.910549 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d21f6-6879-4044-ad34-2ac6bd343c6e None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:15.945100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 230/471] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:06:15 2022] POST /identity/v3/users => generated 248 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:15.946448 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff2af-0c89-418e-af4c-fe3eec981423 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:15.946758 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff2af-0c89-418e-af4c-fe3eec981423 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:15.947074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff2af-0c89-418e-af4c-fe3eec981423 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:15.948723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 231/472] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:15.950428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ff2af-0c89-418e-af4c-fe3eec981423 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:16.034886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:16.044535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d21f6-6879-4044-ad34-2ac6bd343c6e None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:16.066681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:16.086052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ff2af-0c89-418e-af4c-fe3eec981423 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:16.086513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6cae1-fe16-4d84-aa19-99557b979e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:16.087514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6cae1-fe16-4d84-aa19-99557b979e85 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:16.088149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6cae1-fe16-4d84-aa19-99557b979e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:16.088539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6cae1-fe16-4d84-aa19-99557b979e85 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:16.089690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6cae1-fe16-4d84-aa19-99557b979e85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:16.092044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6cae1-fe16-4d84-aa19-99557b979e85 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:16.126710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef51cb-0d8a-4270-9684-40945dc4b56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:16.127398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef51cb-0d8a-4270-9684-40945dc4b56a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:16.127681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef51cb-0d8a-4270-9684-40945dc4b56a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:16.127963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef51cb-0d8a-4270-9684-40945dc4b56a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:16.140086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef51cb-0d8a-4270-9684-40945dc4b56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:16.141611 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef51cb-0d8a-4270-9684-40945dc4b56a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-f9ef51cb-0d8a-4270-9684-40945dc4b56a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:16.160054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:16.160951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:16.161859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:16.161859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:16.161859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:16.161859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:16.161859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 232/473] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:16.165871 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f9cb3-2235-4fe6-9b63-9ec87caca532 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:16.166029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f9cb3-2235-4fe6-9b63-9ec87caca532 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:16.166808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f9cb3-2235-4fe6-9b63-9ec87caca532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:16.186219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-812f9cb3-2235-4fe6-9b63-9ec87caca532 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:16.187445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-812f9cb3-2235-4fe6-9b63-9ec87caca532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:16.244012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 242/474] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:06:15 2022] POST /identity/v3/users => generated 248 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:16.244870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6cae1-fe16-4d84-aa19-99557b979e85 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:16.288427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 233/475] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:16.329145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f9cb3-2235-4fe6-9b63-9ec87caca532 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:16.444522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6cae1-fe16-4d84-aa19-99557b979e85 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:16.466460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:16.499705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1018b4f-cb7a-4597-b1b4-6cc7e78a8955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:16.500445 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1018b4f-cb7a-4597-b1b4-6cc7e78a8955 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:16.500737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1018b4f-cb7a-4597-b1b4-6cc7e78a8955 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:16.501324 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1018b4f-cb7a-4597-b1b4-6cc7e78a8955 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:16.502137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1018b4f-cb7a-4597-b1b4-6cc7e78a8955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:16.502470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1018b4f-cb7a-4597-b1b4-6cc7e78a8955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:16.503845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1018b4f-cb7a-4597-b1b4-6cc7e78a8955 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:16.504895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f9cb3-2235-4fe6-9b63-9ec87caca532 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:16.518194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 243/476] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:16.526575 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1018b4f-cb7a-4597-b1b4-6cc7e78a8955 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:16.545751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:16.546270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186a500-2ba6-4607-9d84-c8f1940b1e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:16.548325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186a500-2ba6-4607-9d84-c8f1940b1e3b None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:16.548608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186a500-2ba6-4607-9d84-c8f1940b1e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:16.548884 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186a500-2ba6-4607-9d84-c8f1940b1e3b None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:16.549743 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186a500-2ba6-4607-9d84-c8f1940b1e3b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:16.551108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186a500-2ba6-4607-9d84-c8f1940b1e3b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:16.603208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.sql.core [None req-4186a500-2ba6-4607-9d84-c8f1940b1e3b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 05:06:16.603208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 05:06:16.603208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [parameters: {'id': 'e5a46708bfac4fbbab40f10e77cb46a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 05:06:16.603208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80699) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-4186a500-2ba6-4607-9d84-c8f1940b1e3b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application conn.query(q) Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application result.read() Aug 04 05:06:16.629033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return ref.to_dict() Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 05:06:16.629994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application next(self.gen) Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application yield resource Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application next(self.gen) Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise self.value Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application session.commit() Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 05:06:16.631320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self.session.flush() Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application compat.raise_( Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 05:06:16.632755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 05:06:16.634432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application conn.query(q) Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application result.read() Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 05:06:16.636082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [parameters: {'id': 'e5a46708bfac4fbbab40f10e77cb46a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:16.637947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 05:06:16.639827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:16.642280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 234/477] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Aug 4 05:06:16 2022] POST /identity/v3/roles => generated 144 bytes in 302 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:16.642280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186a500-2ba6-4607-9d84-c8f1940b1e3b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:16.666133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1018b4f-cb7a-4597-b1b4-6cc7e78a8955 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:16.704390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594fae2-4700-444b-8a20-735aaae86da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:16.705361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594fae2-4700-444b-8a20-735aaae86da0 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:16.705878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594fae2-4700-444b-8a20-735aaae86da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:16.706400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594fae2-4700-444b-8a20-735aaae86da0 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:16.707336 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594fae2-4700-444b-8a20-735aaae86da0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:16.709088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594fae2-4700-444b-8a20-735aaae86da0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:16.783631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186a500-2ba6-4607-9d84-c8f1940b1e3b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:16.815701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:16.821917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b54a63-cf0b-4a6e-8251-010e48d89e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:16.822637 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b54a63-cf0b-4a6e-8251-010e48d89e40 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:16.822995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b54a63-cf0b-4a6e-8251-010e48d89e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:16.823277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b54a63-cf0b-4a6e-8251-010e48d89e40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:16.835868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b54a63-cf0b-4a6e-8251-010e48d89e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-36b54a63-cf0b-4a6e-8251-010e48d89e40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:16.841684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:16.842587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:16.843612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 235/478] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:06:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:16.848832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b54a63-cf0b-4a6e-8251-010e48d89e40 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:16.910401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 244/479] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:06:16 2022] POST /identity/v3/users => generated 249 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:16.980141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b54a63-cf0b-4a6e-8251-010e48d89e40 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:17.025953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518ae6a-7d85-463b-bbcc-8f0180d8cb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:17.026707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ae6a-7d85-463b-bbcc-8f0180d8cb63 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:17.026982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ae6a-7d85-463b-bbcc-8f0180d8cb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:17.027247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ae6a-7d85-463b-bbcc-8f0180d8cb63 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:17.028633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518ae6a-7d85-463b-bbcc-8f0180d8cb63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:17.028937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518ae6a-7d85-463b-bbcc-8f0180d8cb63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:17.030332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518ae6a-7d85-463b-bbcc-8f0180d8cb63 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:17.046861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 236/480] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:17.985058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bd6e1-0ad0-4ab5-bee9-ef906d3f580c None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:17.986084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bd6e1-0ad0-4ab5-bee9-ef906d3f580c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:17.986616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bd6e1-0ad0-4ab5-bee9-ef906d3f580c None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:17.988474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 245/481] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:17.993426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d955041-1f10-47bd-97e6-68234d68ae9e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:17.993859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d955041-1f10-47bd-97e6-68234d68ae9e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:17.994042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d955041-1f10-47bd-97e6-68234d68ae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:18.023291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-7d955041-1f10-47bd-97e6-68234d68ae9e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:18.024525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7d955041-1f10-47bd-97e6-68234d68ae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:18.095798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:18.122798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 237/482] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:18.157891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bd6e1-0ad0-4ab5-bee9-ef906d3f580c None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:18.280093 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:18.327429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bd6e1-0ad0-4ab5-bee9-ef906d3f580c None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:18.352717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bf045-fa97-4098-9d33-c65ce25a73d4 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:18.353019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bf045-fa97-4098-9d33-c65ce25a73d4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:18.353275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bf045-fa97-4098-9d33-c65ce25a73d4 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:18.354934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 238/483] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:18.360124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20763d-9f24-4850-ae94-4edb8ea2584b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:18.360404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20763d-9f24-4850-ae94-4edb8ea2584b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:18.360679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20763d-9f24-4850-ae94-4edb8ea2584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:18.392564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b1ca9-60ba-449f-a31d-80b8fab83681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:18.393553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b1ca9-60ba-449f-a31d-80b8fab83681 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:18.395080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b1ca9-60ba-449f-a31d-80b8fab83681 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:18.395558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b1ca9-60ba-449f-a31d-80b8fab83681 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:18.400860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-bf20763d-9f24-4850-ae94-4edb8ea2584b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:18.402404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-bf20763d-9f24-4850-ae94-4edb8ea2584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:18.420809 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b1ca9-60ba-449f-a31d-80b8fab83681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-336b1ca9-60ba-449f-a31d-80b8fab83681 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:18.428021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:18.428887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:18.429660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:18.436190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 246/484] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:18.443256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b1ca9-60ba-449f-a31d-80b8fab83681 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:18.566765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 239/485] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:06:18.595132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b1ca9-60ba-449f-a31d-80b8fab83681 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:18.604829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20763d-9f24-4850-ae94-4edb8ea2584b None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:18.652002 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:18.665103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8df1-9d63-4b1b-b112-0798bb104123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:18.665735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8df1-9d63-4b1b-b112-0798bb104123 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:18.666014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8df1-9d63-4b1b-b112-0798bb104123 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:18.666288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8df1-9d63-4b1b-b112-0798bb104123 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:18.667063 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f8df1-9d63-4b1b-b112-0798bb104123 None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:18.667365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f8df1-9d63-4b1b-b112-0798bb104123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:18.669007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f8df1-9d63-4b1b-b112-0798bb104123 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:18.682596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 247/486] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:18.685171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137a29-3bb0-48d0-bf70-200674ced221 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:18.685455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137a29-3bb0-48d0-bf70-200674ced221 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:18.686016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137a29-3bb0-48d0-bf70-200674ced221 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:18.687909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 248/487] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:18.690582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137a29-3bb0-48d0-bf70-200674ced221 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:18.742816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20763d-9f24-4850-ae94-4edb8ea2584b None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:18.759407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:18.790279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf1764-dbba-48f5-bb9e-206d6dc39b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:18.791149 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf1764-dbba-48f5-bb9e-206d6dc39b9f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:18.791622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf1764-dbba-48f5-bb9e-206d6dc39b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:18.792125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf1764-dbba-48f5-bb9e-206d6dc39b9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:18.808323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf1764-dbba-48f5-bb9e-206d6dc39b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-19cf1764-dbba-48f5-bb9e-206d6dc39b9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:18.817212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:18.818337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:18.819304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:18.819918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 240/488] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:18.824091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384ee36-8afb-43d5-be3b-1f6326e9e4ad None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:18.824446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384ee36-8afb-43d5-be3b-1f6326e9e4ad None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:18.825305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384ee36-8afb-43d5-be3b-1f6326e9e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:18.827449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137a29-3bb0-48d0-bf70-200674ced221 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:18.847891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-1384ee36-8afb-43d5-be3b-1f6326e9e4ad None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:18.849302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1384ee36-8afb-43d5-be3b-1f6326e9e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:18.872648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f1d9a-7aa0-4d9d-a6e0-15f08f981986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:18.873380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1d9a-7aa0-4d9d-a6e0-15f08f981986 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:18.873722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1d9a-7aa0-4d9d-a6e0-15f08f981986 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:18.874067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1d9a-7aa0-4d9d-a6e0-15f08f981986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:18.888313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f1d9a-7aa0-4d9d-a6e0-15f08f981986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:18.889857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f1d9a-7aa0-4d9d-a6e0-15f08f981986 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-e56f1d9a-7aa0-4d9d-a6e0-15f08f981986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:18.909750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:18.910693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:18.911528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:18.911528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:18.911528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:18.911528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:18.911528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 249/489] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:18.912568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f1d9a-7aa0-4d9d-a6e0-15f08f981986 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:18.937395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 241/490] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:18.938593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384ee36-8afb-43d5-be3b-1f6326e9e4ad None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:18.962416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:19.036516 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f1d9a-7aa0-4d9d-a6e0-15f08f981986 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:19.075992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29370a-5dbb-4457-83cb-30a60abd8f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:19.076816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29370a-5dbb-4457-83cb-30a60abd8f88 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.077144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29370a-5dbb-4457-83cb-30a60abd8f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.077523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29370a-5dbb-4457-83cb-30a60abd8f88 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.078435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29370a-5dbb-4457-83cb-30a60abd8f88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:19.078942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29370a-5dbb-4457-83cb-30a60abd8f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:19.080331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384ee36-8afb-43d5-be3b-1f6326e9e4ad None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:19.080817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29370a-5dbb-4457-83cb-30a60abd8f88 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:19.082659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:19.093650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 250/491] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:19.094679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29370a-5dbb-4457-83cb-30a60abd8f88 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:19.128835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5999e9-8536-4a41-bbea-8845edaddaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:19.130109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5999e9-8536-4a41-bbea-8845edaddaeb None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.130572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5999e9-8536-4a41-bbea-8845edaddaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.131228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5999e9-8536-4a41-bbea-8845edaddaeb None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.132341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5999e9-8536-4a41-bbea-8845edaddaeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:19.132792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5999e9-8536-4a41-bbea-8845edaddaeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:19.135062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5999e9-8536-4a41-bbea-8845edaddaeb None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:19.164871 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 242/492] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:19.166709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5999e9-8536-4a41-bbea-8845edaddaeb None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:19.224292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29370a-5dbb-4457-83cb-30a60abd8f88 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:19.226659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:19.278615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5999e9-8536-4a41-bbea-8845edaddaeb None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:19.280064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51388baf-ac98-46ff-a7b2-c5a9ce0cffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:19.281752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51388baf-ac98-46ff-a7b2-c5a9ce0cffad None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.282359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51388baf-ac98-46ff-a7b2-c5a9ce0cffad None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.282835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51388baf-ac98-46ff-a7b2-c5a9ce0cffad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.295956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51388baf-ac98-46ff-a7b2-c5a9ce0cffad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-51388baf-ac98-46ff-a7b2-c5a9ce0cffad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:19.301621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:19.302585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 251/493] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:19.304011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51388baf-ac98-46ff-a7b2-c5a9ce0cffad None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:19.325110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7309d70-0dbc-40dd-a898-4843d5cf18e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:19.326574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7309d70-0dbc-40dd-a898-4843d5cf18e5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.327469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7309d70-0dbc-40dd-a898-4843d5cf18e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.327961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7309d70-0dbc-40dd-a898-4843d5cf18e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.343343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7309d70-0dbc-40dd-a898-4843d5cf18e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:19.346333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7309d70-0dbc-40dd-a898-4843d5cf18e5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-e7309d70-0dbc-40dd-a898-4843d5cf18e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:19.366956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:19.367862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:19.368717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:19.368717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:19.368717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:19.368717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:19.372395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 243/494] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:19.373503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7309d70-0dbc-40dd-a898-4843d5cf18e5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:19.406703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:19.423033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51388baf-ac98-46ff-a7b2-c5a9ce0cffad None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:19.468059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57089b4a-2ca7-40de-8c5d-d70f6a2fa6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:19.469699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089b4a-2ca7-40de-8c5d-d70f6a2fa6ce None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.470175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089b4a-2ca7-40de-8c5d-d70f6a2fa6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.471106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089b4a-2ca7-40de-8c5d-d70f6a2fa6ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.481970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57089b4a-2ca7-40de-8c5d-d70f6a2fa6ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:19.484509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57089b4a-2ca7-40de-8c5d-d70f6a2fa6ce None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:19.495559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7309d70-0dbc-40dd-a898-4843d5cf18e5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-57089b4a-2ca7-40de-8c5d-d70f6a2fa6ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:19.502543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:19.503641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:19.504741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:19.504741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:19.504741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:19.504741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:19.504741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:19.504741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:19.504741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:19.504741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:19.504741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:19.504741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:19.507012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 252/495] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 4 05:06:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:19.508059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57089b4a-2ca7-40de-8c5d-d70f6a2fa6ce None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:19.542729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:19.542925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab634-378e-4c6a-9c72-09e5e0a7164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:19.544412 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab634-378e-4c6a-9c72-09e5e0a7164a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.544805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab634-378e-4c6a-9c72-09e5e0a7164a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.545183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab634-378e-4c6a-9c72-09e5e0a7164a None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.546021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab634-378e-4c6a-9c72-09e5e0a7164a None admin] RBAC: Adding query filter params (name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:19.546470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab634-378e-4c6a-9c72-09e5e0a7164a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:19.548229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab634-378e-4c6a-9c72-09e5e0a7164a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:19.558610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 244/496] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:19.559082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab634-378e-4c6a-9c72-09e5e0a7164a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:19.642033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:19.643971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57089b4a-2ca7-40de-8c5d-d70f6a2fa6ce None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:19.666952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab634-378e-4c6a-9c72-09e5e0a7164a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:19.681437 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc0600-0cf9-4901-b563-305c8cbb195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:19.682088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc0600-0cf9-4901-b563-305c8cbb195f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.682394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc0600-0cf9-4901-b563-305c8cbb195f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.682896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc0600-0cf9-4901-b563-305c8cbb195f None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.683350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc0600-0cf9-4901-b563-305c8cbb195f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:19.683666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc0600-0cf9-4901-b563-305c8cbb195f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:19.685113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc0600-0cf9-4901-b563-305c8cbb195f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:19.700827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 253/497] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:19.700827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc0600-0cf9-4901-b563-305c8cbb195f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:19.710572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1e5a-39c1-49de-98f6-9eb721856ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:19.711184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1e5a-39c1-49de-98f6-9eb721856ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.711462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1e5a-39c1-49de-98f6-9eb721856ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.711734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1e5a-39c1-49de-98f6-9eb721856ac3 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.712524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af1e5a-39c1-49de-98f6-9eb721856ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:19.716826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af1e5a-39c1-49de-98f6-9eb721856ac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:19.716826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af1e5a-39c1-49de-98f6-9eb721856ac3 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:19.750914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 245/498] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 4 05:06:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:19.752238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdb473-f387-4d1b-aaa7-9de68661f05d None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.752529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdb473-f387-4d1b-aaa7-9de68661f05d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.752807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdb473-f387-4d1b-aaa7-9de68661f05d None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.754174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 246/499] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:19.758725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdb473-f387-4d1b-aaa7-9de68661f05d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:19.785172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:19.804013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc0600-0cf9-4901-b563-305c8cbb195f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:19.839147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132255bb-a6ef-48bc-8892-b2e69584af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:19.839778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132255bb-a6ef-48bc-8892-b2e69584af8d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.840682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132255bb-a6ef-48bc-8892-b2e69584af8d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.841052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132255bb-a6ef-48bc-8892-b2e69584af8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.851164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132255bb-a6ef-48bc-8892-b2e69584af8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:19.852597 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132255bb-a6ef-48bc-8892-b2e69584af8d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:19.861634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdb473-f387-4d1b-aaa7-9de68661f05d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-132255bb-a6ef-48bc-8892-b2e69584af8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:19.867088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:19.868058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:19.868911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:19.868911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:19.868911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:19.868911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:19.868911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 254/500] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:19.869545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271d242-a4f2-4bfc-94af-cba26e9068c6 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.869737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271d242-a4f2-4bfc-94af-cba26e9068c6 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.870017 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271d242-a4f2-4bfc-94af-cba26e9068c6 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.871344 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 255/501] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:19.872049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271d242-a4f2-4bfc-94af-cba26e9068c6 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:19.900116 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175d660-96b1-4ab2-8d4f-b7418fb9169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:19.900671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d660-96b1-4ab2-8d4f-b7418fb9169c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.900950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d660-96b1-4ab2-8d4f-b7418fb9169c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.901217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d660-96b1-4ab2-8d4f-b7418fb9169c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.903792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:19.909383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175d660-96b1-4ab2-8d4f-b7418fb9169c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:19.910925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175d660-96b1-4ab2-8d4f-b7418fb9169c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-9175d660-96b1-4ab2-8d4f-b7418fb9169c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:19.924292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:19.925180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:19.926079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 247/502] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:19.927128 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e1304-5d91-40e8-9776-3ec2107247e7 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:19.927128 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e1304-5d91-40e8-9776-3ec2107247e7 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:19.927348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e1304-5d91-40e8-9776-3ec2107247e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:19.945529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c11e1304-5d91-40e8-9776-3ec2107247e7 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:19.947511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c11e1304-5d91-40e8-9776-3ec2107247e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:19.977813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271d242-a4f2-4bfc-94af-cba26e9068c6 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:20.011205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ebd41-b705-43a1-9235-578dbd73f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:20.012332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ebd41-b705-43a1-9235-578dbd73f706 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:20.012616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ebd41-b705-43a1-9235-578dbd73f706 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:20.012890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ebd41-b705-43a1-9235-578dbd73f706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:20.013689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 248/503] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:20.014562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e1304-5d91-40e8-9776-3ec2107247e7 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:20.029125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:20.094859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ebd41-b705-43a1-9235-578dbd73f706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:20.096294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ebd41-b705-43a1-9235-578dbd73f706 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:20.117039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e1304-5d91-40e8-9776-3ec2107247e7 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:20.141937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:20.164819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9fe69-b029-46a8-b2eb-e71654fa0d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:20.164819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9fe69-b029-46a8-b2eb-e71654fa0d85 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:20.164819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9fe69-b029-46a8-b2eb-e71654fa0d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:20.164819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9fe69-b029-46a8-b2eb-e71654fa0d85 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:20.165252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9fe69-b029-46a8-b2eb-e71654fa0d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:20.165252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9fe69-b029-46a8-b2eb-e71654fa0d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:20.165252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9fe69-b029-46a8-b2eb-e71654fa0d85 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:20.170466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 249/504] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:20.171690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cd853-a69d-424d-a8c2-374cb77f9de2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:20.172241 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cd853-a69d-424d-a8c2-374cb77f9de2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:20.172769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cd853-a69d-424d-a8c2-374cb77f9de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:20.191893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b47cd853-a69d-424d-a8c2-374cb77f9de2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:20.193797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b47cd853-a69d-424d-a8c2-374cb77f9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:20.195782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 256/505] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:20.196706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ebd41-b705-43a1-9235-578dbd73f706 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:20.228981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:20.263824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 250/506] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:20.264671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cd853-a69d-424d-a8c2-374cb77f9de2 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:20.296621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ebd41-b705-43a1-9235-578dbd73f706 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:20.331376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebde41f-ab28-4bcc-8bc1-48d2eb5ce2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:20.331982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebde41f-ab28-4bcc-8bc1-48d2eb5ce2fc None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:20.332399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebde41f-ab28-4bcc-8bc1-48d2eb5ce2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:20.332668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebde41f-ab28-4bcc-8bc1-48d2eb5ce2fc None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:20.333454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebde41f-ab28-4bcc-8bc1-48d2eb5ce2fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:20.333754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebde41f-ab28-4bcc-8bc1-48d2eb5ce2fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:20.335188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebde41f-ab28-4bcc-8bc1-48d2eb5ce2fc None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:20.368880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cd853-a69d-424d-a8c2-374cb77f9de2 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:20.376417 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 257/507] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 4 05:06:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:20.376417 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebde41f-ab28-4bcc-8bc1-48d2eb5ce2fc None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:20.384678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:20.406112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8a0b-cb85-442a-a460-03a0b3770ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:20.406775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8a0b-cb85-442a-a460-03a0b3770ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:20.407099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8a0b-cb85-442a-a460-03a0b3770ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:20.407372 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8a0b-cb85-442a-a460-03a0b3770ea9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:20.417683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e8a0b-cb85-442a-a460-03a0b3770ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-216e8a0b-cb85-442a-a460-03a0b3770ea9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:20.423172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:20.424045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:20.424886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 251/508] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:20.425532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8a0b-cb85-442a-a460-03a0b3770ea9 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:20.469091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:20.478077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebde41f-ab28-4bcc-8bc1-48d2eb5ce2fc None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:20.512829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44106c6-8b04-4b39-a1ba-c95c36a339ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:20.513464 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44106c6-8b04-4b39-a1ba-c95c36a339ef None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:20.513747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44106c6-8b04-4b39-a1ba-c95c36a339ef None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:20.514016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44106c6-8b04-4b39-a1ba-c95c36a339ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:20.521198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44106c6-8b04-4b39-a1ba-c95c36a339ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:20.522682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44106c6-8b04-4b39-a1ba-c95c36a339ef None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:20.525399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8a0b-cb85-442a-a460-03a0b3770ea9 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-e44106c6-8b04-4b39-a1ba-c95c36a339ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:20.534142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:20.535085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:20.535976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 258/509] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:20.536524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44106c6-8b04-4b39-a1ba-c95c36a339ef None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:20.564814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfc747-bb31-4ac0-b065-0cfeda7128ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:20.565446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfc747-bb31-4ac0-b065-0cfeda7128ee None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:20.565729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfc747-bb31-4ac0-b065-0cfeda7128ee None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:20.565999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfc747-bb31-4ac0-b065-0cfeda7128ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:20.576329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfc747-bb31-4ac0-b065-0cfeda7128ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:20.577782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfc747-bb31-4ac0-b065-0cfeda7128ee None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-f7dfc747-bb31-4ac0-b065-0cfeda7128ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:20.592348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:20.593410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:20.594657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:20.594657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:20.594657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:20.594657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:20.594657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 252/510] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:20.594657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfc747-bb31-4ac0-b065-0cfeda7128ee None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:20.626678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:20.641110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44106c6-8b04-4b39-a1ba-c95c36a339ef None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:20.679573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30ee9-66d4-4b52-a91e-0f54aa441cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:20.680118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30ee9-66d4-4b52-a91e-0f54aa441cda None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:20.680395 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30ee9-66d4-4b52-a91e-0f54aa441cda None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:20.680668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30ee9-66d4-4b52-a91e-0f54aa441cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:20.691486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30ee9-66d4-4b52-a91e-0f54aa441cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:20.692942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30ee9-66d4-4b52-a91e-0f54aa441cda None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:20.700207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfc747-bb31-4ac0-b065-0cfeda7128ee None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-68e30ee9-66d4-4b52-a91e-0f54aa441cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:20.707357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:20.708419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:20.709284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:20.709284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:20.709284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:20.709284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:20.709284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 259/511] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:20.709555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30ee9-66d4-4b52-a91e-0f54aa441cda None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:20.713953 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:20.739325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa7614-0b09-4d05-90b3-daa34b779f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:20.739990 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa7614-0b09-4d05-90b3-daa34b779f75 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:20.740267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa7614-0b09-4d05-90b3-daa34b779f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:20.740576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa7614-0b09-4d05-90b3-daa34b779f75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:20.811669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa7614-0b09-4d05-90b3-daa34b779f75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:20.812729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30ee9-66d4-4b52-a91e-0f54aa441cda None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:20.813128 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa7614-0b09-4d05-90b3-daa34b779f75 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:20.839473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:20.846950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba3cd-1820-429e-a88d-11697077a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:20.847568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba3cd-1820-429e-a88d-11697077a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:20.847848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba3cd-1820-429e-a88d-11697077a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:20.848126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba3cd-1820-429e-a88d-11697077a5e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:20.851796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba3cd-1820-429e-a88d-11697077a5e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:20.851796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba3cd-1820-429e-a88d-11697077a5e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:20.851796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba3cd-1820-429e-a88d-11697077a5e2 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:20.859676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 260/512] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:20.860554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba3cd-1820-429e-a88d-11697077a5e2 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:20.915106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 253/513] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:20.915946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa7614-0b09-4d05-90b3-daa34b779f75 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:20.932811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:20.968785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba3cd-1820-429e-a88d-11697077a5e2 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.003086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971ac7-43aa-45b3-a957-fe8622dbc7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.003962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971ac7-43aa-45b3-a957-fe8622dbc7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.004240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971ac7-43aa-45b3-a957-fe8622dbc7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.004571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971ac7-43aa-45b3-a957-fe8622dbc7c6 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.005367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971ac7-43aa-45b3-a957-fe8622dbc7c6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:21.005670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971ac7-43aa-45b3-a957-fe8622dbc7c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.007119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971ac7-43aa-45b3-a957-fe8622dbc7c6 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.019848 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa7614-0b09-4d05-90b3-daa34b779f75 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.024263 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 261/514] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 4 05:06:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:21.024263 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971ac7-43aa-45b3-a957-fe8622dbc7c6 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.048331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:21.057497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43606e79-fb9f-4fed-a931-4fb0feb89e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.058109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43606e79-fb9f-4fed-a931-4fb0feb89e97 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.058417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43606e79-fb9f-4fed-a931-4fb0feb89e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.058850 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43606e79-fb9f-4fed-a931-4fb0feb89e97 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.059548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43606e79-fb9f-4fed-a931-4fb0feb89e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:21.059847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43606e79-fb9f-4fed-a931-4fb0feb89e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.064484 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43606e79-fb9f-4fed-a931-4fb0feb89e97 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.072727 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 254/515] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:21.073356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43606e79-fb9f-4fed-a931-4fb0feb89e97 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.133243 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971ac7-43aa-45b3-a957-fe8622dbc7c6 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.160693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:21.173858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f51dbd-9ce1-42df-a357-7b15b715b5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.178903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51dbd-9ce1-42df-a357-7b15b715b5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.178903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51dbd-9ce1-42df-a357-7b15b715b5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.178903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51dbd-9ce1-42df-a357-7b15b715b5c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.178903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f51dbd-9ce1-42df-a357-7b15b715b5c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:21.178903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f51dbd-9ce1-42df-a357-7b15b715b5c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.178903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f51dbd-9ce1-42df-a357-7b15b715b5c0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.180083 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43606e79-fb9f-4fed-a931-4fb0feb89e97 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.189058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 262/516] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:21.190788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f51dbd-9ce1-42df-a357-7b15b715b5c0 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.216497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135be63-5542-43d0-86db-6ef477c6c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.217113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135be63-5542-43d0-86db-6ef477c6c98a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.217390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135be63-5542-43d0-86db-6ef477c6c98a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.217689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135be63-5542-43d0-86db-6ef477c6c98a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.228027 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135be63-5542-43d0-86db-6ef477c6c98a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.229467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135be63-5542-43d0-86db-6ef477c6c98a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-4135be63-5542-43d0-86db-6ef477c6c98a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:21.245519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:21.246700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:21.247552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:21.247552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:21.247552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:21.247552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:21.247552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 255/517] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:21.247820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135be63-5542-43d0-86db-6ef477c6c98a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.289008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:21.298193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f51dbd-9ce1-42df-a357-7b15b715b5c0 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.333685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c820b83-eee5-4e0d-98c5-9a7f4994142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.334505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c820b83-eee5-4e0d-98c5-9a7f4994142d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.334781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c820b83-eee5-4e0d-98c5-9a7f4994142d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.335050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c820b83-eee5-4e0d-98c5-9a7f4994142d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.347007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c820b83-eee5-4e0d-98c5-9a7f4994142d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.348502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c820b83-eee5-4e0d-98c5-9a7f4994142d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.350952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135be63-5542-43d0-86db-6ef477c6c98a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-6c820b83-eee5-4e0d-98c5-9a7f4994142d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:21.362649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:21.363698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:21.364562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:21.364562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:21.364562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:21.364562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:21.364562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 263/518] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:21.364820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c820b83-eee5-4e0d-98c5-9a7f4994142d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.390146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7494d9-ac39-48f9-8102-4d54e9e2797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.390790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7494d9-ac39-48f9-8102-4d54e9e2797b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.391069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7494d9-ac39-48f9-8102-4d54e9e2797b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.391352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7494d9-ac39-48f9-8102-4d54e9e2797b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.400759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:21.460154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7494d9-ac39-48f9-8102-4d54e9e2797b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.461551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7494d9-ac39-48f9-8102-4d54e9e2797b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.466023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c820b83-eee5-4e0d-98c5-9a7f4994142d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.499283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b2747-7600-42af-a56a-ae599885d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.499925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b2747-7600-42af-a56a-ae599885d727 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.500186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b2747-7600-42af-a56a-ae599885d727 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.500455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b2747-7600-42af-a56a-ae599885d727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.501482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:21.507113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b2747-7600-42af-a56a-ae599885d727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.508586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b2747-7600-42af-a56a-ae599885d727 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-2b6b2747-7600-42af-a56a-ae599885d727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:21.521291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:21.522302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:21.523190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:21.523190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:21.523190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:21.523190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:21.523190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:21.523190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:21.523190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:21.523190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:21.523190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 264/519] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:21.523190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b2747-7600-42af-a56a-ae599885d727 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.567442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 256/520] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:21.568590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7494d9-ac39-48f9-8102-4d54e9e2797b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.620126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:21.626895 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b2747-7600-42af-a56a-ae599885d727 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.661735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441282-a76b-4b3c-a599-1e134a0f2d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.662364 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441282-a76b-4b3c-a599-1e134a0f2d9d None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.662645 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441282-a76b-4b3c-a599-1e134a0f2d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.662910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441282-a76b-4b3c-a599-1e134a0f2d9d None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.663579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae441282-a76b-4b3c-a599-1e134a0f2d9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.664988 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae441282-a76b-4b3c-a599-1e134a0f2d9d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.669875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7494d9-ac39-48f9-8102-4d54e9e2797b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.702547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a12ec-e828-4c0b-ad42-fd39bb4203f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.703154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a12ec-e828-4c0b-ad42-fd39bb4203f6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.703428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a12ec-e828-4c0b-ad42-fd39bb4203f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.703699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a12ec-e828-4c0b-ad42-fd39bb4203f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.704386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a12ec-e828-4c0b-ad42-fd39bb4203f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:21.704688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a12ec-e828-4c0b-ad42-fd39bb4203f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.706062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a12ec-e828-4c0b-ad42-fd39bb4203f6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.713328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:21.719315 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 257/521] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:21.720183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a12ec-e828-4c0b-ad42-fd39bb4203f6 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.745671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 265/522] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:06:21 2022] POST /identity/v3/users => generated 247 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:21.746618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441282-a76b-4b3c-a599-1e134a0f2d9d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.841626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a12ec-e828-4c0b-ad42-fd39bb4203f6 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.874396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441282-a76b-4b3c-a599-1e134a0f2d9d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:21.878592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690af903-dec2-4450-8c53-f33773788d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.879224 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af903-dec2-4450-8c53-f33773788d9c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.879499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af903-dec2-4450-8c53-f33773788d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.879765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af903-dec2-4450-8c53-f33773788d9c None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.880455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690af903-dec2-4450-8c53-f33773788d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:21.880765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690af903-dec2-4450-8c53-f33773788d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.882137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690af903-dec2-4450-8c53-f33773788d9c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.894142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 258/523] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:21.895332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690af903-dec2-4450-8c53-f33773788d9c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.917741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bc409-de24-49ba-b490-00147377eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:21.919783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bc409-de24-49ba-b490-00147377eff7 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:21.920270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bc409-de24-49ba-b490-00147377eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:21.920744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bc409-de24-49ba-b490-00147377eff7 None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:21.921568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bc409-de24-49ba-b490-00147377eff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:21.921875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bc409-de24-49ba-b490-00147377eff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:21.923579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bc409-de24-49ba-b490-00147377eff7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:21.943919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 266/524] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:21.945164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bc409-de24-49ba-b490-00147377eff7 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:21.963070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:21.966502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:22.012524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690af903-dec2-4450-8c53-f33773788d9c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:22.048772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cacaea-5d57-4f39-9e85-9cdccdb54887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:22.049819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cacaea-5d57-4f39-9e85-9cdccdb54887 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:22.050279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cacaea-5d57-4f39-9e85-9cdccdb54887 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:22.050722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cacaea-5d57-4f39-9e85-9cdccdb54887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:22.059072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bc409-de24-49ba-b490-00147377eff7 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:22.063263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cacaea-5d57-4f39-9e85-9cdccdb54887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:22.064996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cacaea-5d57-4f39-9e85-9cdccdb54887 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-58cacaea-5d57-4f39-9e85-9cdccdb54887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:22.082644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:22.083813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:22.089098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:22.089098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:22.089098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:22.089098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:22.089098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 259/525] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:22.089098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cacaea-5d57-4f39-9e85-9cdccdb54887 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:22.107325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8317c7-c9cc-475a-af7d-cb498efbb08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:22.107974 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8317c7-c9cc-475a-af7d-cb498efbb08c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:22.108251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8317c7-c9cc-475a-af7d-cb498efbb08c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:22.108520 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8317c7-c9cc-475a-af7d-cb498efbb08c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:22.116440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8317c7-c9cc-475a-af7d-cb498efbb08c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:22.117947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8317c7-c9cc-475a-af7d-cb498efbb08c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-df8317c7-c9cc-475a-af7d-cb498efbb08c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:22.131096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:22.132131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:22.133006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 267/526] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:22.135069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8317c7-c9cc-475a-af7d-cb498efbb08c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:22.207568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cacaea-5d57-4f39-9e85-9cdccdb54887 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:22.217579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:22.222335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:22.248609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5b255-559b-4a71-a765-de133483f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:22.249247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5b255-559b-4a71-a765-de133483f132 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:22.249520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5b255-559b-4a71-a765-de133483f132 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:22.249787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5b255-559b-4a71-a765-de133483f132 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:22.250062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8317c7-c9cc-475a-af7d-cb498efbb08c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:22.258072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5b255-559b-4a71-a765-de133483f132 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:22.259331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5b255-559b-4a71-a765-de133483f132 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-06e5b255-559b-4a71-a765-de133483f132 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:22.272664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:22.273620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:22.274471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:22.274471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:22.274471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:22.274471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:22.274471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:22.274471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:22.274471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:22.274471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:22.278523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 260/527] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:22.279331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5b255-559b-4a71-a765-de133483f132 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:22.291981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc259b25-2fc7-4211-a612-85bacfe07bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:22.292946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259b25-2fc7-4211-a612-85bacfe07bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:22.293920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259b25-2fc7-4211-a612-85bacfe07bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:22.294150 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259b25-2fc7-4211-a612-85bacfe07bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:22.295001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc259b25-2fc7-4211-a612-85bacfe07bf0 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=27f7331502484928ba7f8a4b403bdddd) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:22.295307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc259b25-2fc7-4211-a612-85bacfe07bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:22.296744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc259b25-2fc7-4211-a612-85bacfe07bf0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:22.303072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 268/528] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:22 2022] GET /identity/v3/role_assignments?user.id=27f7331502484928ba7f8a4b403bdddd&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:22.304030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc259b25-2fc7-4211-a612-85bacfe07bf0 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:22.394263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5b255-559b-4a71-a765-de133483f132 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:22.434761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d88775-d404-484b-96f6-634602dd1395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:22.435638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d88775-d404-484b-96f6-634602dd1395 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:22.436284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d88775-d404-484b-96f6-634602dd1395 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:22.436711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d88775-d404-484b-96f6-634602dd1395 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:22.437595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d88775-d404-484b-96f6-634602dd1395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:22.438047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d88775-d404-484b-96f6-634602dd1395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:22.440585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d88775-d404-484b-96f6-634602dd1395 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:22.452137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc259b25-2fc7-4211-a612-85bacfe07bf0 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:22.457444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 261/529] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:22.458791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d88775-d404-484b-96f6-634602dd1395 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:22.493075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630142-4d79-4cb2-8737-cdd3cec6ee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:22.493749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630142-4d79-4cb2-8737-cdd3cec6ee2a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:22.494089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630142-4d79-4cb2-8737-cdd3cec6ee2a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:22.494480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630142-4d79-4cb2-8737-cdd3cec6ee2a None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:22.495356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d630142-4d79-4cb2-8737-cdd3cec6ee2a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:22.495715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d630142-4d79-4cb2-8737-cdd3cec6ee2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:22.497927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d630142-4d79-4cb2-8737-cdd3cec6ee2a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:22.501867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:22.504926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:22.522342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 269/530] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Aug 4 05:06:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:22.523229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630142-4d79-4cb2-8737-cdd3cec6ee2a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:22.601429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d88775-d404-484b-96f6-634602dd1395 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:22.643030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dc6f9-9f4f-4d1c-b2a1-c94372675a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:22.643695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dc6f9-9f4f-4d1c-b2a1-c94372675a77 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:22.643975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dc6f9-9f4f-4d1c-b2a1-c94372675a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:22.644246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dc6f9-9f4f-4d1c-b2a1-c94372675a77 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:22.644345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630142-4d79-4cb2-8737-cdd3cec6ee2a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:22.644995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dc6f9-9f4f-4d1c-b2a1-c94372675a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:22.645296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dc6f9-9f4f-4d1c-b2a1-c94372675a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:22.647032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dc6f9-9f4f-4d1c-b2a1-c94372675a77 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:22.667785 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 262/531] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:22.669675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dc6f9-9f4f-4d1c-b2a1-c94372675a77 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:22.684865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7ae18-7641-43d7-8886-5d4f478c91ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:22.685784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ae18-7641-43d7-8886-5d4f478c91ae None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:22.686062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ae18-7641-43d7-8886-5d4f478c91ae None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:22.686359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ae18-7641-43d7-8886-5d4f478c91ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:22.695065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7ae18-7641-43d7-8886-5d4f478c91ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:22.696960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7ae18-7641-43d7-8886-5d4f478c91ae None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-b8d7ae18-7641-43d7-8886-5d4f478c91ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:22.716010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:22.722294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:22.723306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:22.723306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:22.723306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:22.723306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:22.723306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:22.723306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:22.723306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:22.723306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:22.723306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 270/532] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:22.723306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7ae18-7641-43d7-8886-5d4f478c91ae None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:22.784364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:22.790770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:22.796324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dc6f9-9f4f-4d1c-b2a1-c94372675a77 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:22.841877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06ba9a-1498-4221-b066-aa83c90f692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:22.842728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06ba9a-1498-4221-b066-aa83c90f692a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:22.842928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7ae18-7641-43d7-8886-5d4f478c91ae None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:22.843225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06ba9a-1498-4221-b066-aa83c90f692a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:22.843597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06ba9a-1498-4221-b066-aa83c90f692a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:22.881812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd0c5-4279-4456-803b-a854497549c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:22.882752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd0c5-4279-4456-803b-a854497549c1 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:22.883299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd0c5-4279-4456-803b-a854497549c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:22.883812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd0c5-4279-4456-803b-a854497549c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:22.884821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dd0c5-4279-4456-803b-a854497549c1 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=9fc9a884f16149cda246ea9638621296) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:22.885346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dd0c5-4279-4456-803b-a854497549c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:22.887634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dd0c5-4279-4456-803b-a854497549c1 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:22.895186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 271/533] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:22 2022] GET /identity/v3/role_assignments?user.id=9fc9a884f16149cda246ea9638621296&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:22.896292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd0c5-4279-4456-803b-a854497549c1 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:22.937825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06ba9a-1498-4221-b066-aa83c90f692a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:22.940464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06ba9a-1498-4221-b066-aa83c90f692a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:23.028148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd0c5-4279-4456-803b-a854497549c1 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:23.050944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:23.054278 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:23.082483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 263/534] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:23.091762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06ba9a-1498-4221-b066-aa83c90f692a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:23.096196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca0826-0b59-4283-8cc2-81acfe8780ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:23.096526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca0826-0b59-4283-8cc2-81acfe8780ab None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:23.096755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca0826-0b59-4283-8cc2-81acfe8780ab None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:23.097033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca0826-0b59-4283-8cc2-81acfe8780ab None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:23.097818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca0826-0b59-4283-8cc2-81acfe8780ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:23.098124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca0826-0b59-4283-8cc2-81acfe8780ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:23.099692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca0826-0b59-4283-8cc2-81acfe8780ab None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:23.124649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 272/535] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:23.134259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca0826-0b59-4283-8cc2-81acfe8780ab None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:23.256537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06ba9a-1498-4221-b066-aa83c90f692a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:23.295015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a84742-5e38-4b60-b999-16191a5cac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:23.296020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a84742-5e38-4b60-b999-16191a5cac01 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:23.296492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a84742-5e38-4b60-b999-16191a5cac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:23.297219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a84742-5e38-4b60-b999-16191a5cac01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:23.308212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a84742-5e38-4b60-b999-16191a5cac01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:23.311321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a84742-5e38-4b60-b999-16191a5cac01 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-30a84742-5e38-4b60-b999-16191a5cac01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:23.328366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:23.329333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:23.330153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:23.330153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:23.330153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:23.330153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:23.332018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 264/536] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:23.337534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a84742-5e38-4b60-b999-16191a5cac01 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:23.341598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca0826-0b59-4283-8cc2-81acfe8780ab None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:23.385256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:23.413394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7bfd-a0ca-4ccb-bb71-0b7c43869846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:23.414015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7bfd-a0ca-4ccb-bb71-0b7c43869846 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:23.414292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7bfd-a0ca-4ccb-bb71-0b7c43869846 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:23.414588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7bfd-a0ca-4ccb-bb71-0b7c43869846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:23.415376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7bfd-a0ca-4ccb-bb71-0b7c43869846 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=600993aa29bc452f8658ed8cb426b470) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:23.415683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7bfd-a0ca-4ccb-bb71-0b7c43869846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:23.422385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7bfd-a0ca-4ccb-bb71-0b7c43869846 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:23.428236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 273/537] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:23 2022] GET /identity/v3/role_assignments?user.id=600993aa29bc452f8658ed8cb426b470&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:23.454276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a84742-5e38-4b60-b999-16191a5cac01 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:23.494915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968e4ab-0d50-4fda-82e6-3db1d69cb7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:23.495895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e4ab-0d50-4fda-82e6-3db1d69cb7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:23.497515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e4ab-0d50-4fda-82e6-3db1d69cb7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:23.498063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e4ab-0d50-4fda-82e6-3db1d69cb7f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:23.499008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968e4ab-0d50-4fda-82e6-3db1d69cb7f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:23.499534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968e4ab-0d50-4fda-82e6-3db1d69cb7f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:23.501103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968e4ab-0d50-4fda-82e6-3db1d69cb7f7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:23.515252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 265/538] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:23.521218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7bfd-a0ca-4ccb-bb71-0b7c43869846 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:23.575299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:23.661755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7bfd-a0ca-4ccb-bb71-0b7c43869846 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:23.702533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1284021-0855-44f4-847c-a85342caf223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:23.703196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1284021-0855-44f4-847c-a85342caf223 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:23.703474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1284021-0855-44f4-847c-a85342caf223 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:23.703749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1284021-0855-44f4-847c-a85342caf223 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:23.712108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1284021-0855-44f4-847c-a85342caf223 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:23.713627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1284021-0855-44f4-847c-a85342caf223 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-b1284021-0855-44f4-847c-a85342caf223 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:23.727703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:23.728605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:23.729667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:23.729667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:23.729667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:23.729667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:23.729667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:23.729667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:23.729667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:23.729667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:23.729667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 274/539] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:23.735022 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968e4ab-0d50-4fda-82e6-3db1d69cb7f7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:23.880487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968e4ab-0d50-4fda-82e6-3db1d69cb7f7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:23.882008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:23.917253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371036a-7ae2-4920-a8ce-69f2e001fa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:23.917883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371036a-7ae2-4920-a8ce-69f2e001fa55 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:23.918740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371036a-7ae2-4920-a8ce-69f2e001fa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:23.919018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371036a-7ae2-4920-a8ce-69f2e001fa55 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:23.919782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371036a-7ae2-4920-a8ce-69f2e001fa55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:23.920091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371036a-7ae2-4920-a8ce-69f2e001fa55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:23.921538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371036a-7ae2-4920-a8ce-69f2e001fa55 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:23.935531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 266/540] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:23.941562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1284021-0855-44f4-847c-a85342caf223 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:24.059970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1284021-0855-44f4-847c-a85342caf223 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:24.061496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:24.104885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b9801-4228-4dc5-91c8-b462aad0ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:24.105535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b9801-4228-4dc5-91c8-b462aad0ac4e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:24.106499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b9801-4228-4dc5-91c8-b462aad0ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:24.106780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b9801-4228-4dc5-91c8-b462aad0ac4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:24.107595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b9801-4228-4dc5-91c8-b462aad0ac4e None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=4213a478acfe4cc88df41b3da2d581ee) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:24.107903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b9801-4228-4dc5-91c8-b462aad0ac4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:24.109350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b9801-4228-4dc5-91c8-b462aad0ac4e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:24.118633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 275/541] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:23 2022] GET /identity/v3/role_assignments?user.id=4213a478acfe4cc88df41b3da2d581ee&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:24.152437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e6aac-b098-4c6f-a134-758c2a997378 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:24.152748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e6aac-b098-4c6f-a134-758c2a997378 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:24.153055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e6aac-b098-4c6f-a134-758c2a997378 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:24.154533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 267/542] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:24.160538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9bda-fe33-4d12-9800-f2b0fc1a0a4a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:24.161087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9bda-fe33-4d12-9800-f2b0fc1a0a4a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:24.161087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9bda-fe33-4d12-9800-f2b0fc1a0a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:24.182898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-08cc9bda-fe33-4d12-9800-f2b0fc1a0a4a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:24.184706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-08cc9bda-fe33-4d12-9800-f2b0fc1a0a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:24.278376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 276/543] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:24.312644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e6aac-b098-4c6f-a134-758c2a997378 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:24.429353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e6aac-b098-4c6f-a134-758c2a997378 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:24.467972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb106c71-f6f2-441f-a50e-44588e350a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:24.468618 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106c71-f6f2-441f-a50e-44588e350a48 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:24.468900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106c71-f6f2-441f-a50e-44588e350a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:24.469178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106c71-f6f2-441f-a50e-44588e350a48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:24.480573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb106c71-f6f2-441f-a50e-44588e350a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-bb106c71-f6f2-441f-a50e-44588e350a48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:24.485919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:24.488086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:24.490016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 268/544] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:24.498330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc9bda-fe33-4d12-9800-f2b0fc1a0a4a None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:24.610832 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:24.619977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc9bda-fe33-4d12-9800-f2b0fc1a0a4a None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:24.667139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a416f-2830-46cc-a146-994914e80fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:24.667818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a416f-2830-46cc-a146-994914e80fef None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:24.668137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a416f-2830-46cc-a146-994914e80fef None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:24.668409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a416f-2830-46cc-a146-994914e80fef None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:24.669134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a416f-2830-46cc-a146-994914e80fef None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:24.669432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a416f-2830-46cc-a146-994914e80fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:24.670904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a416f-2830-46cc-a146-994914e80fef None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:24.680069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 277/545] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:24.686223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb106c71-f6f2-441f-a50e-44588e350a48 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:24.715154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:24.798319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb106c71-f6f2-441f-a50e-44588e350a48 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:24.834073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6834c3-1179-47d7-bed0-9878d54a06d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:24.834746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6834c3-1179-47d7-bed0-9878d54a06d0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:24.835026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6834c3-1179-47d7-bed0-9878d54a06d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:24.835301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6834c3-1179-47d7-bed0-9878d54a06d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:24.846432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6834c3-1179-47d7-bed0-9878d54a06d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:24.848044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6834c3-1179-47d7-bed0-9878d54a06d0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-3b6834c3-1179-47d7-bed0-9878d54a06d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:24.864617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:24.866728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:24.868794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:24.868794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:24.868794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:24.868794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:24.868794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 269/546] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:24.879423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a416f-2830-46cc-a146-994914e80fef None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:24.962372 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4372-8d88-409c-af03-83ca13974ed5 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:24.962683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4372-8d88-409c-af03-83ca13974ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:24.962838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4372-8d88-409c-af03-83ca13974ed5 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:24.964460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 270/547] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:06:24.981277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e11a6-e29e-4cd6-9390-f1303e401aaf None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:24.981277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e11a6-e29e-4cd6-9390-f1303e401aaf None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:24.981277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e11a6-e29e-4cd6-9390-f1303e401aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:25.011427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-af8e11a6-e29e-4cd6-9390-f1303e401aaf None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:25.013323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-af8e11a6-e29e-4cd6-9390-f1303e401aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:25.015259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a416f-2830-46cc-a146-994914e80fef None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:25.055813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1701037-b8db-4830-9032-a0a68369b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:25.056431 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1701037-b8db-4830-9032-a0a68369b626 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:25.056706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1701037-b8db-4830-9032-a0a68369b626 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:25.056978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1701037-b8db-4830-9032-a0a68369b626 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:25.057671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1701037-b8db-4830-9032-a0a68369b626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:25.057974 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1701037-b8db-4830-9032-a0a68369b626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:25.059419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1701037-b8db-4830-9032-a0a68369b626 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:25.083552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 278/548] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:25.089371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1701037-b8db-4830-9032-a0a68369b626 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:25.123984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:25.146600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 271/549] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:06:25.187776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e11a6-e29e-4cd6-9390-f1303e401aaf None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:25.190844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:25.274370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1701037-b8db-4830-9032-a0a68369b626 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:25.319099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e11a6-e29e-4cd6-9390-f1303e401aaf None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:25.348257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1f37-61a2-4aec-8754-edf12a08db26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:25.348905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1f37-61a2-4aec-8754-edf12a08db26 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:25.349184 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1f37-61a2-4aec-8754-edf12a08db26 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:25.349458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1f37-61a2-4aec-8754-edf12a08db26 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:25.364082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f1f37-61a2-4aec-8754-edf12a08db26 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:25.365536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f1f37-61a2-4aec-8754-edf12a08db26 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:25.368887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aced7db-4fd2-4b29-9f71-4843274317d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:25.369529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aced7db-4fd2-4b29-9f71-4843274317d8 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:25.369811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aced7db-4fd2-4b29-9f71-4843274317d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:25.370091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aced7db-4fd2-4b29-9f71-4843274317d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-4e7f1f37-61a2-4aec-8754-edf12a08db26 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:25.387210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:25.388987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:25.391174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 279/550] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:25.399320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1f37-61a2-4aec-8754-edf12a08db26 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:25.401282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aced7db-4fd2-4b29-9f71-4843274317d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-9aced7db-4fd2-4b29-9f71-4843274317d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:25.409336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:25.410257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:25.411392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:25.423663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 272/551] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:25.426472 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aced7db-4fd2-4b29-9f71-4843274317d8 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:25.496709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:25.507224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:25.532751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1f37-61a2-4aec-8754-edf12a08db26 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:25.537906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aced7db-4fd2-4b29-9f71-4843274317d8 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:25.574269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5beb3e-0846-4371-a21b-78aa764e5617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:25.575092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5beb3e-0846-4371-a21b-78aa764e5617 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:25.575433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5beb3e-0846-4371-a21b-78aa764e5617 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:25.575782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5beb3e-0846-4371-a21b-78aa764e5617 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:25.576655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5beb3e-0846-4371-a21b-78aa764e5617 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:25.577027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5beb3e-0846-4371-a21b-78aa764e5617 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:25.578619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5beb3e-0846-4371-a21b-78aa764e5617 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:25.583992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcda887-b56b-495c-ad5f-e0f31652ff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:25.584978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcda887-b56b-495c-ad5f-e0f31652ff90 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:25.585434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcda887-b56b-495c-ad5f-e0f31652ff90 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:25.585875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcda887-b56b-495c-ad5f-e0f31652ff90 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:25.586941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcda887-b56b-495c-ad5f-e0f31652ff90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:25.587536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcda887-b56b-495c-ad5f-e0f31652ff90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:25.589364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcda887-b56b-495c-ad5f-e0f31652ff90 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:25.603164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 280/552] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Aug 4 05:06:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:25.603164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1393757-b93c-46b8-af6c-83b67f8a459f None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:25.603164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1393757-b93c-46b8-af6c-83b67f8a459f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:25.603164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1393757-b93c-46b8-af6c-83b67f8a459f None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:25.607910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 281/553] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:25.608830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1393757-b93c-46b8-af6c-83b67f8a459f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:25.613967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 273/554] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:25.616608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a345f-b0d3-43e9-8a53-8c83e3e645fe None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:25.617074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a345f-b0d3-43e9-8a53-8c83e3e645fe None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:25.617544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a345f-b0d3-43e9-8a53-8c83e3e645fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:25.643281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-265a345f-b0d3-43e9-8a53-8c83e3e645fe None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:25.644531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-265a345f-b0d3-43e9-8a53-8c83e3e645fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:25.726570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 274/555] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:25.727541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a345f-b0d3-43e9-8a53-8c83e3e645fe None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:25.737415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1393757-b93c-46b8-af6c-83b67f8a459f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:25.799272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21954e-6eea-476f-ab0b-92916c9b9dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:25.799859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21954e-6eea-476f-ab0b-92916c9b9dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:25.800174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21954e-6eea-476f-ab0b-92916c9b9dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:25.800471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21954e-6eea-476f-ab0b-92916c9b9dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:25.804303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:25.819052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:25.866126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a345f-b0d3-43e9-8a53-8c83e3e645fe None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:25.879983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21954e-6eea-476f-ab0b-92916c9b9dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:25.881592 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21954e-6eea-476f-ab0b-92916c9b9dd8 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:25.903787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884746-ea4d-4eaa-974a-b5000fa896ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:25.904432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884746-ea4d-4eaa-974a-b5000fa896ca None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:25.904710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884746-ea4d-4eaa-974a-b5000fa896ca None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:25.904984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884746-ea4d-4eaa-974a-b5000fa896ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:25.920649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c884746-ea4d-4eaa-974a-b5000fa896ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:25.922623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c884746-ea4d-4eaa-974a-b5000fa896ca None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-7c884746-ea4d-4eaa-974a-b5000fa896ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:25.943216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:25.944190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:25.945263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:25.945263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:25.945263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:25.945263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:25.945263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 275/556] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:25.946519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884746-ea4d-4eaa-974a-b5000fa896ca None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:25.997314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 282/557] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:25.998292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21954e-6eea-476f-ab0b-92916c9b9dd8 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:26.037327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:26.077972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884746-ea4d-4eaa-974a-b5000fa896ca None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:26.087035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:26.112510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac562cd8-396c-49bd-be65-81bb64270cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:26.113145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac562cd8-396c-49bd-be65-81bb64270cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.113254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21954e-6eea-476f-ab0b-92916c9b9dd8 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:26.113418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac562cd8-396c-49bd-be65-81bb64270cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.113688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac562cd8-396c-49bd-be65-81bb64270cf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.127039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac562cd8-396c-49bd-be65-81bb64270cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-ac562cd8-396c-49bd-be65-81bb64270cf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:26.132596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:26.134002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:26.134878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 276/558] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:26.135572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024b65-05f6-46cb-aee3-7ebf4e165d1c None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.135648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024b65-05f6-46cb-aee3-7ebf4e165d1c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.136381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024b65-05f6-46cb-aee3-7ebf4e165d1c None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.138026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 277/559] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:26.138711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024b65-05f6-46cb-aee3-7ebf4e165d1c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:26.162882 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb985d5d-033b-4284-bd6c-acb165aca89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:26.163599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985d5d-033b-4284-bd6c-acb165aca89a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.163831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985d5d-033b-4284-bd6c-acb165aca89a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.164110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985d5d-033b-4284-bd6c-acb165aca89a None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.164816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb985d5d-033b-4284-bd6c-acb165aca89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:26.165123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb985d5d-033b-4284-bd6c-acb165aca89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:26.166514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb985d5d-033b-4284-bd6c-acb165aca89a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:26.186491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 283/560] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:26.187235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb985d5d-033b-4284-bd6c-acb165aca89a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:26.264195 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024b65-05f6-46cb-aee3-7ebf4e165d1c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:26.299843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406162c5-e289-4f9e-8328-17db221a7ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:26.300480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406162c5-e289-4f9e-8328-17db221a7ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.300757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406162c5-e289-4f9e-8328-17db221a7ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.301026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406162c5-e289-4f9e-8328-17db221a7ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.301373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:26.308102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb985d5d-033b-4284-bd6c-acb165aca89a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:26.311985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406162c5-e289-4f9e-8328-17db221a7ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:26.313480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406162c5-e289-4f9e-8328-17db221a7ba3 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-406162c5-e289-4f9e-8328-17db221a7ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:26.329057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:26.330439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:26.331856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:26.331856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:26.331856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:26.331856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:26.331856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 278/561] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:26.331856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974051-bd3c-44d6-9cfb-c14233bed897 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.332192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974051-bd3c-44d6-9cfb-c14233bed897 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.332259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974051-bd3c-44d6-9cfb-c14233bed897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.350482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df81a3-209a-4d0c-8ba0-c7f9d8e620cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:26.351421 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df81a3-209a-4d0c-8ba0-c7f9d8e620cb None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.351833 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-de974051-bd3c-44d6-9cfb-c14233bed897 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:26.352873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df81a3-209a-4d0c-8ba0-c7f9d8e620cb None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.353174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-de974051-bd3c-44d6-9cfb-c14233bed897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:26.353463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df81a3-209a-4d0c-8ba0-c7f9d8e620cb None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.354178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df81a3-209a-4d0c-8ba0-c7f9d8e620cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:26.354554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df81a3-209a-4d0c-8ba0-c7f9d8e620cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:26.357373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df81a3-209a-4d0c-8ba0-c7f9d8e620cb None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:26.369536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:26.370183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 284/562] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:26.371467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df81a3-209a-4d0c-8ba0-c7f9d8e620cb None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:26.430449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 279/563] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:26.431697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974051-bd3c-44d6-9cfb-c14233bed897 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:26.487341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df81a3-209a-4d0c-8ba0-c7f9d8e620cb None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:26.522301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128dc30-7240-438d-b46a-bfa30fe7569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:26.522952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128dc30-7240-438d-b46a-bfa30fe7569f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.523227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128dc30-7240-438d-b46a-bfa30fe7569f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.523491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128dc30-7240-438d-b46a-bfa30fe7569f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.532526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128dc30-7240-438d-b46a-bfa30fe7569f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:26.533960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128dc30-7240-438d-b46a-bfa30fe7569f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:26.542804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974051-bd3c-44d6-9cfb-c14233bed897 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3128dc30-7240-438d-b46a-bfa30fe7569f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:26.546422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:26.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:26.548681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 285/564] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 4 05:06:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:26.549272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128dc30-7240-438d-b46a-bfa30fe7569f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:26.572600 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:26.587066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b64238-fd7f-42a6-91b2-056af9064b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:26.587066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b64238-fd7f-42a6-91b2-056af9064b60 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.587066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b64238-fd7f-42a6-91b2-056af9064b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.587066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b64238-fd7f-42a6-91b2-056af9064b60 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.587613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b64238-fd7f-42a6-91b2-056af9064b60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:26.587892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b64238-fd7f-42a6-91b2-056af9064b60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:26.589254 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b64238-fd7f-42a6-91b2-056af9064b60 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:26.605929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 280/565] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:26.605929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b64238-fd7f-42a6-91b2-056af9064b60 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:26.617243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:26.662976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128dc30-7240-438d-b46a-bfa30fe7569f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:26.697451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1aca3-4858-4fed-8019-2685712a193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:26.698084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1aca3-4858-4fed-8019-2685712a193e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.698393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1aca3-4858-4fed-8019-2685712a193e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.698670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1aca3-4858-4fed-8019-2685712a193e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.706207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b64238-fd7f-42a6-91b2-056af9064b60 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:26.711371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1aca3-4858-4fed-8019-2685712a193e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:26.712818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1aca3-4858-4fed-8019-2685712a193e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-40f1aca3-4858-4fed-8019-2685712a193e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:26.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:26.729835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:26.731006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:26.731006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:26.731006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:26.731006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:26.731006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 286/566] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:26.731006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1aca3-4858-4fed-8019-2685712a193e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:26.745982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075d696-810b-4ab7-8b0b-7331fbb20023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:26.746803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d696-810b-4ab7-8b0b-7331fbb20023 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.747082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d696-810b-4ab7-8b0b-7331fbb20023 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.747358 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d696-810b-4ab7-8b0b-7331fbb20023 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.757553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075d696-810b-4ab7-8b0b-7331fbb20023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-7075d696-810b-4ab7-8b0b-7331fbb20023 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:26.763653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:26.764756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:26.765748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 281/567] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:26.766674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075d696-810b-4ab7-8b0b-7331fbb20023 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:26.807298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:26.836866 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:26.838862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1aca3-4858-4fed-8019-2685712a193e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:26.872484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d9b7b-3f96-4d76-a951-3ee68965d470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:26.873059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d9b7b-3f96-4d76-a951-3ee68965d470 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.873337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d9b7b-3f96-4d76-a951-3ee68965d470 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.873610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d9b7b-3f96-4d76-a951-3ee68965d470 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.874440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d9b7b-3f96-4d76-a951-3ee68965d470 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:26.874747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d9b7b-3f96-4d76-a951-3ee68965d470 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:26.876171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d9b7b-3f96-4d76-a951-3ee68965d470 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:26.893867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 287/568] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 4 05:06:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:26.895180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9bddf-d24f-4368-9ab7-ff33f6e4a6d3 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.895571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9bddf-d24f-4368-9ab7-ff33f6e4a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.895770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9bddf-d24f-4368-9ab7-ff33f6e4a6d3 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.898533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 288/569] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:26.898533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9bddf-d24f-4368-9ab7-ff33f6e4a6d3 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:26.903890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075d696-810b-4ab7-8b0b-7331fbb20023 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:26.939200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9c6cd-a540-4757-8063-6b648431487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:26.939827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9c6cd-a540-4757-8063-6b648431487a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:26.940101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9c6cd-a540-4757-8063-6b648431487a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:26.940368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9c6cd-a540-4757-8063-6b648431487a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:26.947003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9c6cd-a540-4757-8063-6b648431487a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:26.948485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9c6cd-a540-4757-8063-6b648431487a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-87e9c6cd-a540-4757-8063-6b648431487a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:26.960719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:26.961681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:26.963771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:26.963771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:26.963771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:26.963771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:26.963771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:26.963771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:26.963771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:26.963771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:26.963771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 282/570] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:26.963771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9c6cd-a540-4757-8063-6b648431487a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.013131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9bddf-d24f-4368-9ab7-ff33f6e4a6d3 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.040548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:27.048853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355ae9-eceb-49b7-b7cd-85adfb30e93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.054007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355ae9-eceb-49b7-b7cd-85adfb30e93d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.054007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355ae9-eceb-49b7-b7cd-85adfb30e93d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.054007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355ae9-eceb-49b7-b7cd-85adfb30e93d None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.054007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9355ae9-eceb-49b7-b7cd-85adfb30e93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:27.054007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9355ae9-eceb-49b7-b7cd-85adfb30e93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:27.054007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9355ae9-eceb-49b7-b7cd-85adfb30e93d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:27.067665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 289/571] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:27.068476 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355ae9-eceb-49b7-b7cd-85adfb30e93d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.074213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9c6cd-a540-4757-8063-6b648431487a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.103439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:27.109512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942b842-13c9-45a3-acd0-160f6589aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.110168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b842-13c9-45a3-acd0-160f6589aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.110468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b842-13c9-45a3-acd0-160f6589aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.113596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b842-13c9-45a3-acd0-160f6589aeb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.113596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942b842-13c9-45a3-acd0-160f6589aeb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:27.113596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942b842-13c9-45a3-acd0-160f6589aeb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:27.113596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942b842-13c9-45a3-acd0-160f6589aeb5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:27.123425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 283/572] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:27.124652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66496f7-7ec2-4caa-8be7-6110f9a1d9c0 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.124933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66496f7-7ec2-4caa-8be7-6110f9a1d9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.125207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66496f7-7ec2-4caa-8be7-6110f9a1d9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.144280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e66496f7-7ec2-4caa-8be7-6110f9a1d9c0 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:27.145751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e66496f7-7ec2-4caa-8be7-6110f9a1d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:27.179911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355ae9-eceb-49b7-b7cd-85adfb30e93d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.221958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20626d-d992-41c0-b819-2b8042bb14a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.222639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20626d-d992-41c0-b819-2b8042bb14a4 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.222916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20626d-d992-41c0-b819-2b8042bb14a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.223184 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20626d-d992-41c0-b819-2b8042bb14a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.223581 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 284/573] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:27.224306 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66496f7-7ec2-4caa-8be7-6110f9a1d9c0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.234560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20626d-d992-41c0-b819-2b8042bb14a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:27.236042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20626d-d992-41c0-b819-2b8042bb14a4 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-1e20626d-d992-41c0-b819-2b8042bb14a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:27.251084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:27.256656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:27.257863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:27.257863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:27.257863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:27.257863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:27.257863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 290/574] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:27.257863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20626d-d992-41c0-b819-2b8042bb14a4 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.298789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:27.338560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66496f7-7ec2-4caa-8be7-6110f9a1d9c0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.357888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20626d-d992-41c0-b819-2b8042bb14a4 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.362032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:27.373786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed8e72-97a7-49fa-8612-17ce4a73bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.374420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed8e72-97a7-49fa-8612-17ce4a73bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.374695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed8e72-97a7-49fa-8612-17ce4a73bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.374966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed8e72-97a7-49fa-8612-17ce4a73bf7e None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.375702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed8e72-97a7-49fa-8612-17ce4a73bf7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:27.376003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed8e72-97a7-49fa-8612-17ce4a73bf7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:27.377427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed8e72-97a7-49fa-8612-17ce4a73bf7e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:27.389430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 285/575] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:27.390217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed8e72-97a7-49fa-8612-17ce4a73bf7e None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.391118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb378-deda-4ca5-831b-a3d7cf9493d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.391749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb378-deda-4ca5-831b-a3d7cf9493d0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.392025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb378-deda-4ca5-831b-a3d7cf9493d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.392296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeb378-deda-4ca5-831b-a3d7cf9493d0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.400865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeb378-deda-4ca5-831b-a3d7cf9493d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:27.402401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeb378-deda-4ca5-831b-a3d7cf9493d0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-6bdeb378-deda-4ca5-831b-a3d7cf9493d0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:27.414279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:27.415348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:27.416304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 291/576] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:27.417400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb378-deda-4ca5-831b-a3d7cf9493d0 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.500382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed8e72-97a7-49fa-8612-17ce4a73bf7e None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.515055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:27.518355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeb378-deda-4ca5-831b-a3d7cf9493d0 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.546041 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9f34-7aaa-4eed-b707-4dec3bd2576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.546693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9f34-7aaa-4eed-b707-4dec3bd2576a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.547234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9f34-7aaa-4eed-b707-4dec3bd2576a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.547503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9f34-7aaa-4eed-b707-4dec3bd2576a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.555248 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbae00b-61b5-4a8f-87fb-be695b9e6ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.556015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbae00b-61b5-4a8f-87fb-be695b9e6ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.556691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbae00b-61b5-4a8f-87fb-be695b9e6ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.557205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbae00b-61b5-4a8f-87fb-be695b9e6ab2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.558330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c9f34-7aaa-4eed-b707-4dec3bd2576a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:27.560654 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c9f34-7aaa-4eed-b707-4dec3bd2576a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:27.570139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbae00b-61b5-4a8f-87fb-be695b9e6ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-343c9f34-7aaa-4eed-b707-4dec3bd2576a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:27.575147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:27.576101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:27.576961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:27.576961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:27.576961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:27.576961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-dbbae00b-61b5-4a8f-87fb-be695b9e6ab2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:27.577189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:27.578021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:27.578888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:27.580333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 286/577] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:27.580416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 292/578] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:27.580416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbae00b-61b5-4a8f-87fb-be695b9e6ab2 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.580580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9f34-7aaa-4eed-b707-4dec3bd2576a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.616177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:27.681752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbae00b-61b5-4a8f-87fb-be695b9e6ab2 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.682589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9f34-7aaa-4eed-b707-4dec3bd2576a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.716710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb289c5f-1012-4a99-937c-e10ea5f921a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.718146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb289c5f-1012-4a99-937c-e10ea5f921a9 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.718146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb289c5f-1012-4a99-937c-e10ea5f921a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.718146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb289c5f-1012-4a99-937c-e10ea5f921a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.718441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f668e-35ee-4b41-b0ec-6de414e070eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.718553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f668e-35ee-4b41-b0ec-6de414e070eb None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.718781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb289c5f-1012-4a99-937c-e10ea5f921a9 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=67ac376400a7466a8e01582efcb91f40) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:27.718886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f668e-35ee-4b41-b0ec-6de414e070eb None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.719068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f668e-35ee-4b41-b0ec-6de414e070eb None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.719165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb289c5f-1012-4a99-937c-e10ea5f921a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:27.719759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f668e-35ee-4b41-b0ec-6de414e070eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:27.720062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f668e-35ee-4b41-b0ec-6de414e070eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:27.720498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb289c5f-1012-4a99-937c-e10ea5f921a9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:27.721422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f668e-35ee-4b41-b0ec-6de414e070eb None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:27.726317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 293/579] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/role_assignments?user.id=67ac376400a7466a8e01582efcb91f40&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:27.727123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb289c5f-1012-4a99-937c-e10ea5f921a9 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.744011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 287/580] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:27.746857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f668e-35ee-4b41-b0ec-6de414e070eb None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.757327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:27.844898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb289c5f-1012-4a99-937c-e10ea5f921a9 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.868678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:27.875245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f668e-35ee-4b41-b0ec-6de414e070eb None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:27.887359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3db45-6f6c-42a7-8982-29f39e7eba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.890078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3db45-6f6c-42a7-8982-29f39e7eba55 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.890078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3db45-6f6c-42a7-8982-29f39e7eba55 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.890078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3db45-6f6c-42a7-8982-29f39e7eba55 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.890078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3db45-6f6c-42a7-8982-29f39e7eba55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:27.890078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3db45-6f6c-42a7-8982-29f39e7eba55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:27.891268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3db45-6f6c-42a7-8982-29f39e7eba55 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:27.912147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 294/581] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:27.912992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3db45-6f6c-42a7-8982-29f39e7eba55 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:27.917942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d158fe-a086-4a02-89b1-117ee1f0738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:27.919649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d158fe-a086-4a02-89b1-117ee1f0738f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:27.919927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d158fe-a086-4a02-89b1-117ee1f0738f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:27.920196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d158fe-a086-4a02-89b1-117ee1f0738f None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:27.920890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d158fe-a086-4a02-89b1-117ee1f0738f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:27.921189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d158fe-a086-4a02-89b1-117ee1f0738f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:27.922837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d158fe-a086-4a02-89b1-117ee1f0738f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:27.935404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 288/582] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:27.936227 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d158fe-a086-4a02-89b1-117ee1f0738f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.007866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:28.029992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3db45-6f6c-42a7-8982-29f39e7eba55 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.053518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d158fe-a086-4a02-89b1-117ee1f0738f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.067725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38915537-a0f9-4d04-a918-aaade2e5003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.068349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915537-a0f9-4d04-a918-aaade2e5003e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.068629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915537-a0f9-4d04-a918-aaade2e5003e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.068907 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915537-a0f9-4d04-a918-aaade2e5003e None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.069621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38915537-a0f9-4d04-a918-aaade2e5003e None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:28.069926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38915537-a0f9-4d04-a918-aaade2e5003e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:28.071329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38915537-a0f9-4d04-a918-aaade2e5003e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:28.080285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 295/583] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:28.081126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38915537-a0f9-4d04-a918-aaade2e5003e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.097582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a503b59-f9e5-4699-816c-d5803895742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.098534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503b59-f9e5-4699-816c-d5803895742c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.098855 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503b59-f9e5-4699-816c-d5803895742c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.099128 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503b59-f9e5-4699-816c-d5803895742c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.108100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a503b59-f9e5-4699-816c-d5803895742c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:28.109530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a503b59-f9e5-4699-816c-d5803895742c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-4a503b59-f9e5-4699-816c-d5803895742c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:28.121034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:28.122327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:28.123213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:28.123213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:28.123213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:28.123213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:28.123213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:28.123213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:28.123213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:28.123213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:28.123213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 289/584] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:28.123716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a503b59-f9e5-4699-816c-d5803895742c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.141820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:28.208219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38915537-a0f9-4d04-a918-aaade2e5003e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.243403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a503b59-f9e5-4699-816c-d5803895742c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.245654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f44154-9a98-48c0-bb23-6e013851da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.246475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f44154-9a98-48c0-bb23-6e013851da63 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.246762 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f44154-9a98-48c0-bb23-6e013851da63 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.247037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f44154-9a98-48c0-bb23-6e013851da63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.258732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f44154-9a98-48c0-bb23-6e013851da63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:28.260165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f44154-9a98-48c0-bb23-6e013851da63 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:28.263820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-c2f44154-9a98-48c0-bb23-6e013851da63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:28.276254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:28.277283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:28.279218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:28.279218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:28.279218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:28.279218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:28.279218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 296/585] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:28.279218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f44154-9a98-48c0-bb23-6e013851da63 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.289444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719167c-a789-45f6-aad0-34dcc799800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.290134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719167c-a789-45f6-aad0-34dcc799800b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.290485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719167c-a789-45f6-aad0-34dcc799800b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.290765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719167c-a789-45f6-aad0-34dcc799800b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.299110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719167c-a789-45f6-aad0-34dcc799800b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:28.300373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719167c-a789-45f6-aad0-34dcc799800b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-9719167c-a789-45f6-aad0-34dcc799800b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:28.312449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:28.313445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 290/586] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:28.314509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719167c-a789-45f6-aad0-34dcc799800b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.396856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f44154-9a98-48c0-bb23-6e013851da63 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.401492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:28.427489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719167c-a789-45f6-aad0-34dcc799800b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.433149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08b2f3-a764-4ac1-adff-3c4c0f283398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.434634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b2f3-a764-4ac1-adff-3c4c0f283398 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.435121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b2f3-a764-4ac1-adff-3c4c0f283398 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.435497 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b2f3-a764-4ac1-adff-3c4c0f283398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.446693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08b2f3-a764-4ac1-adff-3c4c0f283398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:28.448305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08b2f3-a764-4ac1-adff-3c4c0f283398 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-fb08b2f3-a764-4ac1-adff-3c4c0f283398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:28.463769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:28.464951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:28.466695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:28.466695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:28.466695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:28.466695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:28.471910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 297/587] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:28.471910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08b2f3-a764-4ac1-adff-3c4c0f283398 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.472735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f819-91d0-4558-83fd-20cc74785816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.473446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f819-91d0-4558-83fd-20cc74785816 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.473821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f819-91d0-4558-83fd-20cc74785816 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.474354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f819-91d0-4558-83fd-20cc74785816 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.475076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f819-91d0-4558-83fd-20cc74785816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:28.475499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f819-91d0-4558-83fd-20cc74785816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:28.477097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f819-91d0-4558-83fd-20cc74785816 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:28.490379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 291/588] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:28.491200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f819-91d0-4558-83fd-20cc74785816 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.532963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:28.589286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08b2f3-a764-4ac1-adff-3c4c0f283398 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.601795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f819-91d0-4558-83fd-20cc74785816 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.628459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9392a-d7ad-450f-af68-44f7d3b1a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.629076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9392a-d7ad-450f-af68-44f7d3b1a530 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.629358 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9392a-d7ad-450f-af68-44f7d3b1a530 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.629634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9392a-d7ad-450f-af68-44f7d3b1a530 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.630337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9392a-d7ad-450f-af68-44f7d3b1a530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:28.630650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9392a-d7ad-450f-af68-44f7d3b1a530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:28.632018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9392a-d7ad-450f-af68-44f7d3b1a530 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:28.643091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b88a-221a-43ac-9117-6b9f2e79516e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.643886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b88a-221a-43ac-9117-6b9f2e79516e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.644396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b88a-221a-43ac-9117-6b9f2e79516e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.644817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b88a-221a-43ac-9117-6b9f2e79516e None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.645329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 298/589] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:28.645905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9b88a-221a-43ac-9117-6b9f2e79516e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:28.646130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9392a-d7ad-450f-af68-44f7d3b1a530 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.646541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9b88a-221a-43ac-9117-6b9f2e79516e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:28.648056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9b88a-221a-43ac-9117-6b9f2e79516e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:28.649743 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:28.666672 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 292/590] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 4 05:06:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:28.667767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b88a-221a-43ac-9117-6b9f2e79516e None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.768709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9392a-d7ad-450f-af68-44f7d3b1a530 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.774999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b88a-221a-43ac-9117-6b9f2e79516e None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.778753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:28.810334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79745c76-2f47-4149-9c1a-53276fc41abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.810334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745c76-2f47-4149-9c1a-53276fc41abf None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.810334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745c76-2f47-4149-9c1a-53276fc41abf None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.810334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745c76-2f47-4149-9c1a-53276fc41abf None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.810824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79745c76-2f47-4149-9c1a-53276fc41abf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:28.810824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79745c76-2f47-4149-9c1a-53276fc41abf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:28.810824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79745c76-2f47-4149-9c1a-53276fc41abf None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:28.819150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b45bb2-b430-4558-9390-d9826e5f782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.819906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b45bb2-b430-4558-9390-d9826e5f782c None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.820181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b45bb2-b430-4558-9390-d9826e5f782c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.820452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b45bb2-b430-4558-9390-d9826e5f782c None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/27f7331502484928ba7f8a4b403bdddd/roles/16ee851075b24775bcb2377722b5adb4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.825517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 299/591] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:28.825517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79745c76-2f47-4149-9c1a-53276fc41abf None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.837006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b45bb2-b430-4558-9390-d9826e5f782c None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=27f7331502484928ba7f8a4b403bdddd, role_id=16ee851075b24775bcb2377722b5adb4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:28.838538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b45bb2-b430-4558-9390-d9826e5f782c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:28.922443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 293/592] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:06:28 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/27f7331502484928ba7f8a4b403bdddd/roles/16ee851075b24775bcb2377722b5adb4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:28.922443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b45bb2-b430-4558-9390-d9826e5f782c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:28.950241 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79745c76-2f47-4149-9c1a-53276fc41abf None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:28.977135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:28.989922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b515274-cf61-415c-8a24-e9aab9dc1c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:28.990728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b515274-cf61-415c-8a24-e9aab9dc1c28 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:28.991069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b515274-cf61-415c-8a24-e9aab9dc1c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:28.991412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b515274-cf61-415c-8a24-e9aab9dc1c28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:28.999943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b515274-cf61-415c-8a24-e9aab9dc1c28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:29.001652 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b515274-cf61-415c-8a24-e9aab9dc1c28 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-5b515274-cf61-415c-8a24-e9aab9dc1c28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:29.014459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:29.015429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:29.016362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:29.016362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:29.016362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:29.016362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:29.016362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:29.016362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:29.016362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:29.016362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:29.020688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 300/593] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:29.021722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b515274-cf61-415c-8a24-e9aab9dc1c28 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:29.049704 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b45bb2-b430-4558-9390-d9826e5f782c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:29.060361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:29.093108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b3b2b-ca10-4e59-b335-ae1fff1ae7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:29.094961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b3b2b-ca10-4e59-b335-ae1fff1ae7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.095439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b3b2b-ca10-4e59-b335-ae1fff1ae7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.095921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b3b2b-ca10-4e59-b335-ae1fff1ae7a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.110123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b3b2b-ca10-4e59-b335-ae1fff1ae7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:29.111726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b3b2b-ca10-4e59-b335-ae1fff1ae7a5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-288b3b2b-ca10-4e59-b335-ae1fff1ae7a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:29.128725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:29.129834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:29.130991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:29.130991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:29.130991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:29.130991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:29.132512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 294/594] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:29.133529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b3b2b-ca10-4e59-b335-ae1fff1ae7a5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:29.150273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b515274-cf61-415c-8a24-e9aab9dc1c28 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:29.195489 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86842ae3-7447-4c03-9a99-d20978d02330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:29.196408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86842ae3-7447-4c03-9a99-d20978d02330 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.196865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86842ae3-7447-4c03-9a99-d20978d02330 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.197312 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86842ae3-7447-4c03-9a99-d20978d02330 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.208105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86842ae3-7447-4c03-9a99-d20978d02330 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:29.210463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86842ae3-7447-4c03-9a99-d20978d02330 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-86842ae3-7447-4c03-9a99-d20978d02330 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:29.226062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:29.227119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:29.228059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:29.228059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:29.228059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:29.228059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:29.228059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:29.228059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:29.228059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:29.228059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:29.228059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 05:06:29.228059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:29.230124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 301/595] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:29.236753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86842ae3-7447-4c03-9a99-d20978d02330 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:29.268142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:29.276389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b3b2b-ca10-4e59-b335-ae1fff1ae7a5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:29.325816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5630a-7f66-40b0-b399-b0e3340e36ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:29.326477 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5630a-7f66-40b0-b399-b0e3340e36ce None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.326761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5630a-7f66-40b0-b399-b0e3340e36ce None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.327038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5630a-7f66-40b0-b399-b0e3340e36ce None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.328284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5630a-7f66-40b0-b399-b0e3340e36ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:29.328607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5630a-7f66-40b0-b399-b0e3340e36ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:29.330554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5630a-7f66-40b0-b399-b0e3340e36ce None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:29.341643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:29.352681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 295/596] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:29.352681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5630a-7f66-40b0-b399-b0e3340e36ce None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:29.361385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86842ae3-7447-4c03-9a99-d20978d02330 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:29.413669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b8bba-0a2e-469b-b5e0-c5a3a972d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:29.414388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8bba-0a2e-469b-b5e0-c5a3a972d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.414601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8bba-0a2e-469b-b5e0-c5a3a972d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.414873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8bba-0a2e-469b-b5e0-c5a3a972d1d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.416003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b8bba-0a2e-469b-b5e0-c5a3a972d1d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:29.416311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b8bba-0a2e-469b-b5e0-c5a3a972d1d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:29.417690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b8bba-0a2e-469b-b5e0-c5a3a972d1d2 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:29.439375 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 302/597] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:29.439375 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b8bba-0a2e-469b-b5e0-c5a3a972d1d2 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:29.477135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5630a-7f66-40b0-b399-b0e3340e36ce None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:29.515647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868445a-5b2a-49fe-b703-f4d8925cb9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:29.516666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868445a-5b2a-49fe-b703-f4d8925cb9ea None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.517139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868445a-5b2a-49fe-b703-f4d8925cb9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.517655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868445a-5b2a-49fe-b703-f4d8925cb9ea None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.518776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868445a-5b2a-49fe-b703-f4d8925cb9ea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:29.519300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868445a-5b2a-49fe-b703-f4d8925cb9ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:29.520977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868445a-5b2a-49fe-b703-f4d8925cb9ea None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:29.541003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 296/598] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Aug 4 05:06:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:29.547327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868445a-5b2a-49fe-b703-f4d8925cb9ea None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:29.564016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:29.565645 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b8bba-0a2e-469b-b5e0-c5a3a972d1d2 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:29.610992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16167c5-fc49-44c8-a3b4-fb46b7e13965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:29.611907 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16167c5-fc49-44c8-a3b4-fb46b7e13965 None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.612179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16167c5-fc49-44c8-a3b4-fb46b7e13965 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.612450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16167c5-fc49-44c8-a3b4-fb46b7e13965 None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/9fc9a884f16149cda246ea9638621296/roles/16ee851075b24775bcb2377722b5adb4` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.633518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16167c5-fc49-44c8-a3b4-fb46b7e13965 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=9fc9a884f16149cda246ea9638621296, role_id=16ee851075b24775bcb2377722b5adb4)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:29.636140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16167c5-fc49-44c8-a3b4-fb46b7e13965 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:29.667319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868445a-5b2a-49fe-b703-f4d8925cb9ea None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:29.703928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8a7e4-19ea-4243-aa1e-379df94d7850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:29.707392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8a7e4-19ea-4243-aa1e-379df94d7850 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.707392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8a7e4-19ea-4243-aa1e-379df94d7850 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.707392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8a7e4-19ea-4243-aa1e-379df94d7850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.711371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:29.716941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8a7e4-19ea-4243-aa1e-379df94d7850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:29.721800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8a7e4-19ea-4243-aa1e-379df94d7850 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:29.721943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 303/599] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:06:29 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/9fc9a884f16149cda246ea9638621296/roles/16ee851075b24775bcb2377722b5adb4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:29.721943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16167c5-fc49-44c8-a3b4-fb46b7e13965 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-2fb8a7e4-19ea-4243-aa1e-379df94d7850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:29.734127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:29.735101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:29.735998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:29.735998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:29.735998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:29.735998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:29.735998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:29.735998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:29.735998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:29.735998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:29.735998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 297/600] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:29.741437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8a7e4-19ea-4243-aa1e-379df94d7850 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:29.823553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:29.861501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8a7e4-19ea-4243-aa1e-379df94d7850 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:29.872965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16167c5-fc49-44c8-a3b4-fb46b7e13965 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:29.900470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba981895-9362-4de5-8491-dabd7177fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:29.901099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba981895-9362-4de5-8491-dabd7177fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.901379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba981895-9362-4de5-8491-dabd7177fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.901656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba981895-9362-4de5-8491-dabd7177fbe0 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.902749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba981895-9362-4de5-8491-dabd7177fbe0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:29.903060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba981895-9362-4de5-8491-dabd7177fbe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:29.904510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba981895-9362-4de5-8491-dabd7177fbe0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:29.914566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e24369-349e-47cf-96c6-9ccb605738b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:29.915627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e24369-349e-47cf-96c6-9ccb605738b9 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.916274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e24369-349e-47cf-96c6-9ccb605738b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.916743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e24369-349e-47cf-96c6-9ccb605738b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.919023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 298/601] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:29.920317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fb71f-2a1a-4e7e-a3bb-8a6800fc5fb4 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.920596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fb71f-2a1a-4e7e-a3bb-8a6800fc5fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.920882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fb71f-2a1a-4e7e-a3bb-8a6800fc5fb4 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.927790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 299/602] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:29.928872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fb71f-2a1a-4e7e-a3bb-8a6800fc5fb4 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:29.931244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e24369-349e-47cf-96c6-9ccb605738b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:29.933047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e24369-349e-47cf-96c6-9ccb605738b9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-16e24369-349e-47cf-96c6-9ccb605738b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:29.950651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:29.951584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:29.952484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:29.952484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:29.952484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:29.952484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:29.953565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 304/603] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:29.957890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faede6-8a0d-4666-8f5b-5bfba05373c0 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:29.957890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faede6-8a0d-4666-8f5b-5bfba05373c0 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:29.957890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faede6-8a0d-4666-8f5b-5bfba05373c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:29.977743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c0faede6-8a0d-4666-8f5b-5bfba05373c0 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:29.978994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c0faede6-8a0d-4666-8f5b-5bfba05373c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:30.030329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:30.051668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 305/604] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:30.054935 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0faede6-8a0d-4666-8f5b-5bfba05373c0 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:30.066539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fb71f-2a1a-4e7e-a3bb-8a6800fc5fb4 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:30.112915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:30.118166 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15d4f9-9c2e-48b1-8d70-67920fcae78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:30.118891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15d4f9-9c2e-48b1-8d70-67920fcae78a None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:30.119174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15d4f9-9c2e-48b1-8d70-67920fcae78a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:30.119454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15d4f9-9c2e-48b1-8d70-67920fcae78a None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/600993aa29bc452f8658ed8cb426b470/roles/16ee851075b24775bcb2377722b5adb4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:30.135432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15d4f9-9c2e-48b1-8d70-67920fcae78a None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=600993aa29bc452f8658ed8cb426b470, role_id=16ee851075b24775bcb2377722b5adb4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:30.137467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15d4f9-9c2e-48b1-8d70-67920fcae78a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:30.191916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0faede6-8a0d-4666-8f5b-5bfba05373c0 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:30.233271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7df2d-3927-479a-9526-7e3d48ae5b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:30.234433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7df2d-3927-479a-9526-7e3d48ae5b6b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:30.234945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7df2d-3927-479a-9526-7e3d48ae5b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:30.235468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7df2d-3927-479a-9526-7e3d48ae5b6b None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:30.236494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7df2d-3927-479a-9526-7e3d48ae5b6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:30.237056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7df2d-3927-479a-9526-7e3d48ae5b6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:30.238486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 300/605] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:06:29 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/600993aa29bc452f8658ed8cb426b470/roles/16ee851075b24775bcb2377722b5adb4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:30.239191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7df2d-3927-479a-9526-7e3d48ae5b6b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:30.239503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15d4f9-9c2e-48b1-8d70-67920fcae78a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:30.257048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 306/606] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:30.265315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7df2d-3927-479a-9526-7e3d48ae5b6b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:30.345639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:30.411518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7df2d-3927-479a-9526-7e3d48ae5b6b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:30.429536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15d4f9-9c2e-48b1-8d70-67920fcae78a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:30.450707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81439af-c501-4661-8f27-bc92a3578f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:30.451659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81439af-c501-4661-8f27-bc92a3578f83 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:30.451946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81439af-c501-4661-8f27-bc92a3578f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:30.452314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81439af-c501-4661-8f27-bc92a3578f83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:30.459775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81439af-c501-4661-8f27-bc92a3578f83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:30.461373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81439af-c501-4661-8f27-bc92a3578f83 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:30.472787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccf28e-51cd-4a18-adf3-5df21ec4cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:30.473683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccf28e-51cd-4a18-adf3-5df21ec4cce1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:30.474105 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccf28e-51cd-4a18-adf3-5df21ec4cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:30.474552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccf28e-51cd-4a18-adf3-5df21ec4cce1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-d81439af-c501-4661-8f27-bc92a3578f83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:30.474790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:30.475816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:30.476920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:30.476920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:30.476920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:30.476920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:30.476920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:30.476920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:30.476920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:30.476920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:30.482513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 307/607] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:30.484679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81439af-c501-4661-8f27-bc92a3578f83 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:30.491337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccf28e-51cd-4a18-adf3-5df21ec4cce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-a3ccf28e-51cd-4a18-adf3-5df21ec4cce1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:30.498129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:30.499151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:30.500009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:30.502643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 301/608] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:30.509757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccf28e-51cd-4a18-adf3-5df21ec4cce1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:30.578784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:30.587435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:30.590255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81439af-c501-4661-8f27-bc92a3578f83 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:30.626188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380419f2-3846-48dc-af43-cd744b625154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:30.626908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380419f2-3846-48dc-af43-cd744b625154 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:30.627186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380419f2-3846-48dc-af43-cd744b625154 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:30.627462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380419f2-3846-48dc-af43-cd744b625154 None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:30.628259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380419f2-3846-48dc-af43-cd744b625154 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:30.628623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380419f2-3846-48dc-af43-cd744b625154 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:30.630049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380419f2-3846-48dc-af43-cd744b625154 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:30.650498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 308/609] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:30.650498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380419f2-3846-48dc-af43-cd744b625154 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:30.686336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccf28e-51cd-4a18-adf3-5df21ec4cce1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:30.751137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5511b2-76b7-44dc-aba0-cf569ae93fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:30.752130 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5511b2-76b7-44dc-aba0-cf569ae93fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:30.752607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5511b2-76b7-44dc-aba0-cf569ae93fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:30.753077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5511b2-76b7-44dc-aba0-cf569ae93fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:30.753995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5511b2-76b7-44dc-aba0-cf569ae93fe7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:30.754658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5511b2-76b7-44dc-aba0-cf569ae93fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:30.755291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380419f2-3846-48dc-af43-cd744b625154 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:30.756493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5511b2-76b7-44dc-aba0-cf569ae93fe7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:30.770567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 302/610] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:30.775703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5511b2-76b7-44dc-aba0-cf569ae93fe7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:30.794834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9126f-6a4b-45cd-b164-eeecb7b92c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:30.794834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9126f-6a4b-45cd-b164-eeecb7b92c1e None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:30.794834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9126f-6a4b-45cd-b164-eeecb7b92c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:30.794834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9126f-6a4b-45cd-b164-eeecb7b92c1e None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/4213a478acfe4cc88df41b3da2d581ee/roles/16ee851075b24775bcb2377722b5adb4` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:30.810040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9126f-6a4b-45cd-b164-eeecb7b92c1e None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=4213a478acfe4cc88df41b3da2d581ee, role_id=16ee851075b24775bcb2377722b5adb4)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:30.811665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9126f-6a4b-45cd-b164-eeecb7b92c1e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:30.877910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 309/611] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:06:30 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/4213a478acfe4cc88df41b3da2d581ee/roles/16ee851075b24775bcb2377722b5adb4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:06:30.919303 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5511b2-76b7-44dc-aba0-cf569ae93fe7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:30.922183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:30.957152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaaf6a-6303-4402-a93d-90fbee16344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:30.957820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaaf6a-6303-4402-a93d-90fbee16344d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:30.958102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaaf6a-6303-4402-a93d-90fbee16344d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:30.958402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaaf6a-6303-4402-a93d-90fbee16344d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:30.970507 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaaf6a-6303-4402-a93d-90fbee16344d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:30.972110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaaf6a-6303-4402-a93d-90fbee16344d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-8eeaaf6a-6303-4402-a93d-90fbee16344d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:30.989141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:30.990115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:30.991044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:30.991044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:30.991044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:30.991044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:30.991044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 303/612] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:30.998725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9126f-6a4b-45cd-b164-eeecb7b92c1e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:31.022811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:31.111761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71826780-1434-417e-878a-50b763129812 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:31.112049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71826780-1434-417e-878a-50b763129812 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:31.112331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71826780-1434-417e-878a-50b763129812 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:31.114000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 304/613] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:06:31.119345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7e718-9b9b-4f2a-b634-e267ed45a754 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:31.119618 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7e718-9b9b-4f2a-b634-e267ed45a754 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:31.119896 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7e718-9b9b-4f2a-b634-e267ed45a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:31.144629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8ba7e718-9b9b-4f2a-b634-e267ed45a754 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:31.146192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8ba7e718-9b9b-4f2a-b634-e267ed45a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:31.158349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9126f-6a4b-45cd-b164-eeecb7b92c1e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:31.195455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205788-32a2-4060-ab37-f60e90bffe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:31.196094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205788-32a2-4060-ab37-f60e90bffe04 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:31.196371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205788-32a2-4060-ab37-f60e90bffe04 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:31.196644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205788-32a2-4060-ab37-f60e90bffe04 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:31.197361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed205788-32a2-4060-ab37-f60e90bffe04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:31.197668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed205788-32a2-4060-ab37-f60e90bffe04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:31.199772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed205788-32a2-4060-ab37-f60e90bffe04 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:31.214383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 310/614] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:31.220146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205788-32a2-4060-ab37-f60e90bffe04 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:31.258142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 305/615] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 05:06:31.325329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:31.347851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7e718-9b9b-4f2a-b634-e267ed45a754 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:31.354007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205788-32a2-4060-ab37-f60e90bffe04 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:31.391827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a92fe-6e2c-4618-8147-79ca827856eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:31.392468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a92fe-6e2c-4618-8147-79ca827856eb None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:31.392746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a92fe-6e2c-4618-8147-79ca827856eb None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:31.393019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a92fe-6e2c-4618-8147-79ca827856eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:31.403026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a92fe-6e2c-4618-8147-79ca827856eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:31.404794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a92fe-6e2c-4618-8147-79ca827856eb None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3d2a92fe-6e2c-4618-8147-79ca827856eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:31.417353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:31.419221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:31.420229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 311/616] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:31.428731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a92fe-6e2c-4618-8147-79ca827856eb None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:31.521879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:31.548929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7e718-9b9b-4f2a-b634-e267ed45a754 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:31.571892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a92fe-6e2c-4618-8147-79ca827856eb None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:31.606799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:31.614552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ba16-8805-48dd-be36-f969c64053f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:31.615320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ba16-8805-48dd-be36-f969c64053f0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:31.615603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ba16-8805-48dd-be36-f969c64053f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:31.615875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ba16-8805-48dd-be36-f969c64053f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:31.616657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b38e9-186a-4203-90ee-914c7d3b9f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:31.617347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b38e9-186a-4203-90ee-914c7d3b9f3f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:31.617619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b38e9-186a-4203-90ee-914c7d3b9f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:31.617885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b38e9-186a-4203-90ee-914c7d3b9f3f None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:31.618793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b38e9-186a-4203-90ee-914c7d3b9f3f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:31.619123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b38e9-186a-4203-90ee-914c7d3b9f3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:31.620531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b38e9-186a-4203-90ee-914c7d3b9f3f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:31.642512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 312/617] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Aug 4 05:06:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:31.648025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b38e9-186a-4203-90ee-914c7d3b9f3f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:31.652185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3ba16-8805-48dd-be36-f969c64053f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-55b3ba16-8805-48dd-be36-f969c64053f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:31.657221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:31.658122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:31.659197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:31.666610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 306/618] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:31.683371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ba16-8805-48dd-be36-f969c64053f0 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:31.767838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b38e9-186a-4203-90ee-914c7d3b9f3f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:31.810502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355fc2e-8596-4bea-8c43-d3cc4825a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:31.811740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355fc2e-8596-4bea-8c43-d3cc4825a026 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:31.811979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355fc2e-8596-4bea-8c43-d3cc4825a026 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:31.812399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355fc2e-8596-4bea-8c43-d3cc4825a026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:31.823935 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355fc2e-8596-4bea-8c43-d3cc4825a026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:31.825865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355fc2e-8596-4bea-8c43-d3cc4825a026 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-2355fc2e-8596-4bea-8c43-d3cc4825a026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:31.842705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:31.843617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:31.844493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:31.844493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:31.844493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:31.844493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:31.844493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 313/619] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:31.849331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355fc2e-8596-4bea-8c43-d3cc4825a026 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:31.925529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ba16-8805-48dd-be36-f969c64053f0 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:31.965191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a4f08-5323-4db6-ba3e-f5f293989cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:31.966668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a4f08-5323-4db6-ba3e-f5f293989cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:31.966951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a4f08-5323-4db6-ba3e-f5f293989cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:31.967333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a4f08-5323-4db6-ba3e-f5f293989cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:31.968059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a4f08-5323-4db6-ba3e-f5f293989cf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:31.968361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a4f08-5323-4db6-ba3e-f5f293989cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:31.969815 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a4f08-5323-4db6-ba3e-f5f293989cf9 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:31.978635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:31.984392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 307/620] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:32.007754 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a4f08-5323-4db6-ba3e-f5f293989cf9 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:32.019416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:32.122863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a4f08-5323-4db6-ba3e-f5f293989cf9 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:32.130383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355fc2e-8596-4bea-8c43-d3cc4825a026 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:32.161099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ef261-aa9c-4153-a018-2740a5857426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:32.161724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ef261-aa9c-4153-a018-2740a5857426 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.162005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ef261-aa9c-4153-a018-2740a5857426 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.162275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ef261-aa9c-4153-a018-2740a5857426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.175818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ef261-aa9c-4153-a018-2740a5857426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:32.177272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ef261-aa9c-4153-a018-2740a5857426 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-652ef261-aa9c-4153-a018-2740a5857426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:32.194394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:32.195314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:32.196225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:32.196225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:32.196225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:32.196225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:32.196225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 308/621] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:32.201610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ef261-aa9c-4153-a018-2740a5857426 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:32.235438 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8bda0-6f0b-414f-92ac-8a06285b807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:32.236483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8bda0-6f0b-414f-92ac-8a06285b807d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.236761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8bda0-6f0b-414f-92ac-8a06285b807d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.237035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8bda0-6f0b-414f-92ac-8a06285b807d None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.237739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8bda0-6f0b-414f-92ac-8a06285b807d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:32.238043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8bda0-6f0b-414f-92ac-8a06285b807d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:32.243634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8bda0-6f0b-414f-92ac-8a06285b807d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:32.271625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 314/622] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:32.277157 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8bda0-6f0b-414f-92ac-8a06285b807d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:32.299944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:32.351993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ef261-aa9c-4153-a018-2740a5857426 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:32.401617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc74de-28ec-46e0-a845-1ac854854c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:32.403078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc74de-28ec-46e0-a845-1ac854854c6f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.403520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc74de-28ec-46e0-a845-1ac854854c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.404138 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc74de-28ec-46e0-a845-1ac854854c6f None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.405481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc74de-28ec-46e0-a845-1ac854854c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:32.405954 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc74de-28ec-46e0-a845-1ac854854c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:32.408012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc74de-28ec-46e0-a845-1ac854854c6f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:32.414839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:32.422622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8bda0-6f0b-414f-92ac-8a06285b807d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:32.433292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 309/623] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:32.433292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0fac4-b899-4721-83db-de28b20f20bd None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.433292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0fac4-b899-4721-83db-de28b20f20bd None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.433292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0fac4-b899-4721-83db-de28b20f20bd None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.433292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 310/624] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:32.433292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0fac4-b899-4721-83db-de28b20f20bd None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:32.465818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6c4d9-2349-43ab-bedb-c51e9c0d3c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:32.467089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6c4d9-2349-43ab-bedb-c51e9c0d3c0c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.467352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6c4d9-2349-43ab-bedb-c51e9c0d3c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.467694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6c4d9-2349-43ab-bedb-c51e9c0d3c0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.475500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6c4d9-2349-43ab-bedb-c51e9c0d3c0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:32.477194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6c4d9-2349-43ab-bedb-c51e9c0d3c0c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-0be6c4d9-2349-43ab-bedb-c51e9c0d3c0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:32.491362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:32.492495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:32.493641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:32.493641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:32.493641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:32.493641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:32.493641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:32.493641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:32.493641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:32.493641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:32.494688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 315/625] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:32.496108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7225cf-a855-49db-acd0-cf044b46a432 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.496548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7225cf-a855-49db-acd0-cf044b46a432 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.497177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7225cf-a855-49db-acd0-cf044b46a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.517034 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-6f7225cf-a855-49db-acd0-cf044b46a432 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:32.518515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6f7225cf-a855-49db-acd0-cf044b46a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:32.575254 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0fac4-b899-4721-83db-de28b20f20bd None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:32.598366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:32.601509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 316/626] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:32.601509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7225cf-a855-49db-acd0-cf044b46a432 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:32.632825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e129e-4973-4848-99ed-af1d8d68c261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:32.633470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e129e-4973-4848-99ed-af1d8d68c261 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.633744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e129e-4973-4848-99ed-af1d8d68c261 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.634012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e129e-4973-4848-99ed-af1d8d68c261 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.648976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e129e-4973-4848-99ed-af1d8d68c261 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:32.651460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e129e-4973-4848-99ed-af1d8d68c261 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-1c3e129e-4973-4848-99ed-af1d8d68c261 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:32.671004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:32.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:32.673238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:32.673238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:32.673238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:32.673238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:32.673238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:32.673238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:32.673238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:32.673238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:32.673238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:32.673238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:32.676000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 311/627] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 4 05:06:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:32.677463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e129e-4973-4848-99ed-af1d8d68c261 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:32.729091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:32.741880 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7225cf-a855-49db-acd0-cf044b46a432 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:32.786468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5f53b-eb7d-4c51-a463-0b92ece6c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:32.787236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f53b-eb7d-4c51-a463-0b92ece6c446 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.787946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f53b-eb7d-4c51-a463-0b92ece6c446 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.787946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f53b-eb7d-4c51-a463-0b92ece6c446 None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.789116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5f53b-eb7d-4c51-a463-0b92ece6c446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:32.789422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5f53b-eb7d-4c51-a463-0b92ece6c446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:32.791002 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5f53b-eb7d-4c51-a463-0b92ece6c446 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:32.801274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e129e-4973-4848-99ed-af1d8d68c261 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:32.810614 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 317/628] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:32.811756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5f53b-eb7d-4c51-a463-0b92ece6c446 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:32.838777 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d1c6-43de-4467-bca1-922047d74a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:32.839434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d1c6-43de-4467-bca1-922047d74a25 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.839724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d1c6-43de-4467-bca1-922047d74a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.840601 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d1c6-43de-4467-bca1-922047d74a25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.854885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2d1c6-43de-4467-bca1-922047d74a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-9bf2d1c6-43de-4467-bca1-922047d74a25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:32.860657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:32.861795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:32.862689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 312/629] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:32.863409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334657a-137d-4254-8728-c26c01729903 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.863552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334657a-137d-4254-8728-c26c01729903 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.863823 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334657a-137d-4254-8728-c26c01729903 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.866129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 313/630] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:32.866129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334657a-137d-4254-8728-c26c01729903 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:32.915111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:32.939018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5f53b-eb7d-4c51-a463-0b92ece6c446 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:32.975324 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247ab3a-dee2-4c08-a3b6-419f387e27ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:32.975971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ab3a-dee2-4c08-a3b6-419f387e27ee None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:32.976231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ab3a-dee2-4c08-a3b6-419f387e27ee None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:32.976499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ab3a-dee2-4c08-a3b6-419f387e27ee None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:32.977297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247ab3a-dee2-4c08-a3b6-419f387e27ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:32.977398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334657a-137d-4254-8728-c26c01729903 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:32.977601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247ab3a-dee2-4c08-a3b6-419f387e27ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:32.979327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247ab3a-dee2-4c08-a3b6-419f387e27ee None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:33.003737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 318/631] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 4 05:06:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:33.004702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247ab3a-dee2-4c08-a3b6-419f387e27ee None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:33.015331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:33.019669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b135856-20b9-438c-981c-2cc4ef28ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:33.021143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135856-20b9-438c-981c-2cc4ef28ca2e None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.021143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135856-20b9-438c-981c-2cc4ef28ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.021538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135856-20b9-438c-981c-2cc4ef28ca2e None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/67ac376400a7466a8e01582efcb91f40/roles/16ee851075b24775bcb2377722b5adb4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:33.038625 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b135856-20b9-438c-981c-2cc4ef28ca2e None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=67ac376400a7466a8e01582efcb91f40, role_id=16ee851075b24775bcb2377722b5adb4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:33.040338 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b135856-20b9-438c-981c-2cc4ef28ca2e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:33.113944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 314/632] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:06:32 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/67ac376400a7466a8e01582efcb91f40/roles/16ee851075b24775bcb2377722b5adb4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:33.114196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247ab3a-dee2-4c08-a3b6-419f387e27ee None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:33.114299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb078b5-9a23-496c-9eed-6f4cd8d599ce None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.114299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb078b5-9a23-496c-9eed-6f4cd8d599ce None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.114299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb078b5-9a23-496c-9eed-6f4cd8d599ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:33.128720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-6eb078b5-9a23-496c-9eed-6f4cd8d599ce None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:33.130270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6eb078b5-9a23-496c-9eed-6f4cd8d599ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:33.155229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd26f38-4b7b-4047-8a21-f8b9303b18cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:33.155975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26f38-4b7b-4047-8a21-f8b9303b18cb None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.159479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26f38-4b7b-4047-8a21-f8b9303b18cb None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.159479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26f38-4b7b-4047-8a21-f8b9303b18cb None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:33.159479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd26f38-4b7b-4047-8a21-f8b9303b18cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:33.159479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd26f38-4b7b-4047-8a21-f8b9303b18cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:33.161840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd26f38-4b7b-4047-8a21-f8b9303b18cb None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:33.177313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 319/633] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:33.178389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd26f38-4b7b-4047-8a21-f8b9303b18cb None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:33.240917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 315/634] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:33.242120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb078b5-9a23-496c-9eed-6f4cd8d599ce None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:33.281136 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:33.288132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:33.328536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd26f38-4b7b-4047-8a21-f8b9303b18cb None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:33.363664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06dd92-a05f-4323-91e1-0a4b9ec1123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:33.364290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06dd92-a05f-4323-91e1-0a4b9ec1123e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.364566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06dd92-a05f-4323-91e1-0a4b9ec1123e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.364840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06dd92-a05f-4323-91e1-0a4b9ec1123e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:33.394663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb078b5-9a23-496c-9eed-6f4cd8d599ce None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:33.430142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb59e7-6ac0-4630-bdcf-2cca07e5c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:33.431029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb59e7-6ac0-4630-bdcf-2cca07e5c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.431312 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb59e7-6ac0-4630-bdcf-2cca07e5c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.431590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb59e7-6ac0-4630-bdcf-2cca07e5c4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:33.437726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06dd92-a05f-4323-91e1-0a4b9ec1123e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:33.439635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06dd92-a05f-4323-91e1-0a4b9ec1123e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:33.442011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb59e7-6ac0-4630-bdcf-2cca07e5c4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:33.443493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb59e7-6ac0-4630-bdcf-2cca07e5c4b6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-dbdb59e7-6ac0-4630-bdcf-2cca07e5c4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:33.460717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:33.461665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:33.462598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:33.462598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:33.462598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:33.462598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:33.467304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 316/635] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:33.468130 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb59e7-6ac0-4630-bdcf-2cca07e5c4b6 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:33.519901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:33.552246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:33.558834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 320/636] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:33.558834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3b9e4-d74a-4ba9-856f-97986f20604d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.558834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3b9e4-d74a-4ba9-856f-97986f20604d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.558834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3b9e4-d74a-4ba9-856f-97986f20604d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:33.558834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 321/637] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:33.558834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3b9e4-d74a-4ba9-856f-97986f20604d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:33.589151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb59e7-6ac0-4630-bdcf-2cca07e5c4b6 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:33.632347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da63426-0c93-478e-a170-17f16cdf75c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:33.632988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da63426-0c93-478e-a170-17f16cdf75c3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.633267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da63426-0c93-478e-a170-17f16cdf75c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.633544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da63426-0c93-478e-a170-17f16cdf75c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:33.645197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da63426-0c93-478e-a170-17f16cdf75c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-7da63426-0c93-478e-a170-17f16cdf75c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:33.650678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:33.651649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:33.652553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 317/638] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:33.653274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da63426-0c93-478e-a170-17f16cdf75c3 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:33.684616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3b9e4-d74a-4ba9-856f-97986f20604d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:33.724386 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01156a9-a88a-4229-b4f9-6e91800f317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:33.725341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01156a9-a88a-4229-b4f9-6e91800f317f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.725795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01156a9-a88a-4229-b4f9-6e91800f317f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.726315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01156a9-a88a-4229-b4f9-6e91800f317f None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:33.727088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01156a9-a88a-4229-b4f9-6e91800f317f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:33.728052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01156a9-a88a-4229-b4f9-6e91800f317f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:33.728728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01156a9-a88a-4229-b4f9-6e91800f317f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:33.745807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 322/639] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:33.745807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545f3f4-7397-4b3a-83da-2d176012e226 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.745807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545f3f4-7397-4b3a-83da-2d176012e226 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.745807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545f3f4-7397-4b3a-83da-2d176012e226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:33.763091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0545f3f4-7397-4b3a-83da-2d176012e226 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:33.764256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0545f3f4-7397-4b3a-83da-2d176012e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:33.765478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da63426-0c93-478e-a170-17f16cdf75c3 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:33.790346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:33.800139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:33.805505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2fdbc-0198-4559-b2f0-5ec27411bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:33.806460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2fdbc-0198-4559-b2f0-5ec27411bbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.806919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2fdbc-0198-4559-b2f0-5ec27411bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.807368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2fdbc-0198-4559-b2f0-5ec27411bbf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:33.819228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2fdbc-0198-4559-b2f0-5ec27411bbf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:33.820908 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2fdbc-0198-4559-b2f0-5ec27411bbf8 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-58c2fdbc-0198-4559-b2f0-5ec27411bbf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:33.841761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:33.842878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:33.843769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:33.843769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:33.843769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:33.843769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:33.843989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 323/640] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:33.843989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545f3f4-7397-4b3a-83da-2d176012e226 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:33.844125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 318/641] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:33.844125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2fdbc-0198-4559-b2f0-5ec27411bbf8 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:33.956606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2fdbc-0198-4559-b2f0-5ec27411bbf8 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:33.973419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545f3f4-7397-4b3a-83da-2d176012e226 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:33.991649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe42e-a6ac-4d2e-9074-3bd8831edd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:33.992179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe42e-a6ac-4d2e-9074-3bd8831edd66 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:33.992459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe42e-a6ac-4d2e-9074-3bd8831edd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:33.992838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe42e-a6ac-4d2e-9074-3bd8831edd66 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.002649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebe42e-a6ac-4d2e-9074-3bd8831edd66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:34.004021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebe42e-a6ac-4d2e-9074-3bd8831edd66 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:34.012912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564174b-e6e5-4fe3-bd87-cc22f2fe0b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:34.013511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564174b-e6e5-4fe3-bd87-cc22f2fe0b3f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:34.013789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564174b-e6e5-4fe3-bd87-cc22f2fe0b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:34.014064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564174b-e6e5-4fe3-bd87-cc22f2fe0b3f None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.014806 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564174b-e6e5-4fe3-bd87-cc22f2fe0b3f None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:34.015112 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564174b-e6e5-4fe3-bd87-cc22f2fe0b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-92ebe42e-a6ac-4d2e-9074-3bd8831edd66 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:34.016099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:34.017211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:34.018266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:34.018266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:34.018266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:34.018266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:34.018266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:34.018266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:34.018266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:34.018266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:34.018266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 05:06:34.018266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:34.018849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564174b-e6e5-4fe3-bd87-cc22f2fe0b3f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:34.018921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 319/642] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:34.018921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe42e-a6ac-4d2e-9074-3bd8831edd66 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:34.033376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 324/643] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:34.033376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564174b-e6e5-4fe3-bd87-cc22f2fe0b3f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:34.058427 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:34.073641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:34.133147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe42e-a6ac-4d2e-9074-3bd8831edd66 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:34.138274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564174b-e6e5-4fe3-bd87-cc22f2fe0b3f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:34.176228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876707c5-53f2-49d5-938c-392fc3069b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:34.176840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876707c5-53f2-49d5-938c-392fc3069b73 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:34.177120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876707c5-53f2-49d5-938c-392fc3069b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:34.177558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876707c5-53f2-49d5-938c-392fc3069b73 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.178249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876707c5-53f2-49d5-938c-392fc3069b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:34.178585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876707c5-53f2-49d5-938c-392fc3069b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:34.179939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876707c5-53f2-49d5-938c-392fc3069b73 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:34.190220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f450-77a6-414c-91ef-621ae9030b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:34.190919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f450-77a6-414c-91ef-621ae9030b78 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:34.191224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f450-77a6-414c-91ef-621ae9030b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:34.191465 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f450-77a6-414c-91ef-621ae9030b78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.197102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 320/644] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:34.197102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876707c5-53f2-49d5-938c-392fc3069b73 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:34.203738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9f450-77a6-414c-91ef-621ae9030b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-9bd9f450-77a6-414c-91ef-621ae9030b78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:34.208637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:34.209545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 325/645] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:34.210603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f450-77a6-414c-91ef-621ae9030b78 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:34.303947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:34.312153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876707c5-53f2-49d5-938c-392fc3069b73 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:34.315375 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:34.323666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f450-77a6-414c-91ef-621ae9030b78 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:34.347498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b4b34-c04d-4ebb-b519-ac211e564d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:34.348124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b4b34-c04d-4ebb-b519-ac211e564d6d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:34.348407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b4b34-c04d-4ebb-b519-ac211e564d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:34.348680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b4b34-c04d-4ebb-b519-ac211e564d6d None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.349489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b4b34-c04d-4ebb-b519-ac211e564d6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:34.349788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b4b34-c04d-4ebb-b519-ac211e564d6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:34.351268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b4b34-c04d-4ebb-b519-ac211e564d6d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:34.359973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c301b22-0670-4ec4-89a0-816d8e2866e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:34.360741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c301b22-0670-4ec4-89a0-816d8e2866e3 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:34.361018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c301b22-0670-4ec4-89a0-816d8e2866e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:34.361289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c301b22-0670-4ec4-89a0-816d8e2866e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.370183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 321/646] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:34.371985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b4b34-c04d-4ebb-b519-ac211e564d6d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:34.376463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c301b22-0670-4ec4-89a0-816d8e2866e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:34.378082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c301b22-0670-4ec4-89a0-816d8e2866e3 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3c301b22-0670-4ec4-89a0-816d8e2866e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:34.394899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:34.395831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:34.396742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:34.396742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:34.396742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:34.396742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:34.396742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 326/647] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:34.396742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c301b22-0670-4ec4-89a0-816d8e2866e3 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:34.486675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b4b34-c04d-4ebb-b519-ac211e564d6d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:34.508692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c301b22-0670-4ec4-89a0-816d8e2866e3 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:34.522873 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dfc16-dd48-4c66-b127-fff144098226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:34.523567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dfc16-dd48-4c66-b127-fff144098226 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:34.523852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dfc16-dd48-4c66-b127-fff144098226 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:34.524125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dfc16-dd48-4c66-b127-fff144098226 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.531070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dfc16-dd48-4c66-b127-fff144098226 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:34.532519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dfc16-dd48-4c66-b127-fff144098226 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:34.544885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca602027-207a-4379-91b4-93ae9337d5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-e96dfc16-dd48-4c66-b127-fff144098226 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:34.545103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:34.545951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:34.552535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:34.552535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:34.552535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:34.552535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:34.552535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:34.552535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:34.552535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:34.552535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:34.552971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca602027-207a-4379-91b4-93ae9337d5df None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:34.552971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca602027-207a-4379-91b4-93ae9337d5df None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:34.552971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca602027-207a-4379-91b4-93ae9337d5df None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.553158 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 322/648] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:34.553158 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dfc16-dd48-4c66-b127-fff144098226 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:34.553287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca602027-207a-4379-91b4-93ae9337d5df None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:34.553287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca602027-207a-4379-91b4-93ae9337d5df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:34.553287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca602027-207a-4379-91b4-93ae9337d5df None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:34.553287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:34.560033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 327/649] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:34.560846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca602027-207a-4379-91b4-93ae9337d5df None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:34.582525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:34.665600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dfc16-dd48-4c66-b127-fff144098226 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:34.673114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca602027-207a-4379-91b4-93ae9337d5df None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:34.709098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210204b-71f1-4c4a-83cb-f24bb24ad0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:34.710144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210204b-71f1-4c4a-83cb-f24bb24ad0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:34.710144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210204b-71f1-4c4a-83cb-f24bb24ad0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:34.713027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210204b-71f1-4c4a-83cb-f24bb24ad0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.713027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210204b-71f1-4c4a-83cb-f24bb24ad0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:34.713027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210204b-71f1-4c4a-83cb-f24bb24ad0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:34.713027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210204b-71f1-4c4a-83cb-f24bb24ad0b2 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:34.713294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a043c-fe3b-43dc-bc4a-01daaaa7e3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:34.713543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a043c-fe3b-43dc-bc4a-01daaaa7e3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:34.713757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a043c-fe3b-43dc-bc4a-01daaaa7e3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:34.714334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a043c-fe3b-43dc-bc4a-01daaaa7e3c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.725038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 328/650] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:34.726027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210204b-71f1-4c4a-83cb-f24bb24ad0b2 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:34.790187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:34.799899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a043c-fe3b-43dc-bc4a-01daaaa7e3c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:34.801373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a043c-fe3b-43dc-bc4a-01daaaa7e3c4 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:34.826935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:34.843814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210204b-71f1-4c4a-83cb-f24bb24ad0b2 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:34.880775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b79c6-b5d5-4faf-a1d0-68f1b6d9806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:34.881397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b79c6-b5d5-4faf-a1d0-68f1b6d9806d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:34.881674 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b79c6-b5d5-4faf-a1d0-68f1b6d9806d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:34.881945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b79c6-b5d5-4faf-a1d0-68f1b6d9806d None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:34.882747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b79c6-b5d5-4faf-a1d0-68f1b6d9806d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:34.883051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b79c6-b5d5-4faf-a1d0-68f1b6d9806d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:34.884471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b79c6-b5d5-4faf-a1d0-68f1b6d9806d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:34.896912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 329/651] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:34.902859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b79c6-b5d5-4faf-a1d0-68f1b6d9806d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:34.914171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 323/652] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:34.915104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a043c-fe3b-43dc-bc4a-01daaaa7e3c4 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:35.022041 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b79c6-b5d5-4faf-a1d0-68f1b6d9806d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:35.029221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a043c-fe3b-43dc-bc4a-01daaaa7e3c4 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:35.039940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:35.054856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:35.060012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fae181-1ea7-4605-9a53-18a43a8ce517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:35.060652 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fae181-1ea7-4605-9a53-18a43a8ce517 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.060931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fae181-1ea7-4605-9a53-18a43a8ce517 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.061196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fae181-1ea7-4605-9a53-18a43a8ce517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.067631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370085b4-c998-461d-b3e3-6760d8745fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:35.068342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370085b4-c998-461d-b3e3-6760d8745fdc None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.072645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370085b4-c998-461d-b3e3-6760d8745fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.072645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370085b4-c998-461d-b3e3-6760d8745fdc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.072828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fae181-1ea7-4605-9a53-18a43a8ce517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:35.072828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fae181-1ea7-4605-9a53-18a43a8ce517 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:35.076780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370085b4-c998-461d-b3e3-6760d8745fdc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:35.078226 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370085b4-c998-461d-b3e3-6760d8745fdc None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-45fae181-1ea7-4605-9a53-18a43a8ce517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:35.087738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:35.088821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:35.090128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:35.090128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:35.090128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:35.090128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-370085b4-c998-461d-b3e3-6760d8745fdc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:35.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:35.092080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:35.094435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:35.094435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:35.094435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:35.094435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:35.094435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:35.094435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:35.094435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:35.094435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:35.094435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 05:06:35.094435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:35.095982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 330/653] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:35.095982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fae181-1ea7-4605-9a53-18a43a8ce517 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:35.098535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 324/654] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:35.099914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370085b4-c998-461d-b3e3-6760d8745fdc None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:35.217439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fae181-1ea7-4605-9a53-18a43a8ce517 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:35.218816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370085b4-c998-461d-b3e3-6760d8745fdc None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:35.252757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2ce29-30f8-475c-b8d9-59468e0d2daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:35.253359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ce29-30f8-475c-b8d9-59468e0d2daf None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.253642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ce29-30f8-475c-b8d9-59468e0d2daf None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.253910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ce29-30f8-475c-b8d9-59468e0d2daf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.254712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2ce29-30f8-475c-b8d9-59468e0d2daf None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=27f7331502484928ba7f8a4b403bdddd) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:35.255013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2ce29-30f8-475c-b8d9-59468e0d2daf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:35.255297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903790-1934-4954-8162-93b8ac1f958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:35.255945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903790-1934-4954-8162-93b8ac1f958f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.256224 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903790-1934-4954-8162-93b8ac1f958f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.256431 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2ce29-30f8-475c-b8d9-59468e0d2daf None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:35.256559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903790-1934-4954-8162-93b8ac1f958f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.263260 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 331/655] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:35 2022] GET /identity/v3/role_assignments?user.id=27f7331502484928ba7f8a4b403bdddd&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:35.264067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2ce29-30f8-475c-b8d9-59468e0d2daf None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:35.269403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903790-1934-4954-8162-93b8ac1f958f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:35.271653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903790-1934-4954-8162-93b8ac1f958f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-a3903790-1934-4954-8162-93b8ac1f958f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:35.290400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:35.291679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:35.292822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:35.292822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:35.292822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:35.292822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:35.294375 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 325/656] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:35.295321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903790-1934-4954-8162-93b8ac1f958f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:35.312364 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:35.337964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:35.401274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2ce29-30f8-475c-b8d9-59468e0d2daf None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:35.413767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903790-1934-4954-8162-93b8ac1f958f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:35.445499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9686b12-c044-40d2-9d7f-f08d64457f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:35.446062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9686b12-c044-40d2-9d7f-f08d64457f19 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.446410 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9686b12-c044-40d2-9d7f-f08d64457f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.446927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9686b12-c044-40d2-9d7f-f08d64457f19 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.447392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9686b12-c044-40d2-9d7f-f08d64457f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:35.447723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9686b12-c044-40d2-9d7f-f08d64457f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:35.449087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9686b12-c044-40d2-9d7f-f08d64457f19 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:35.459937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f9797-118e-4434-a0bc-f6d0901d361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:35.460558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f9797-118e-4434-a0bc-f6d0901d361b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.460839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f9797-118e-4434-a0bc-f6d0901d361b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.461112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f9797-118e-4434-a0bc-f6d0901d361b None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.461935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f9797-118e-4434-a0bc-f6d0901d361b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:35.462240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f9797-118e-4434-a0bc-f6d0901d361b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:35.464184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f9797-118e-4434-a0bc-f6d0901d361b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:35.467270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 332/657] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:35.469179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e648d-7527-4da1-9d9e-d4237852a37d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.469179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e648d-7527-4da1-9d9e-d4237852a37d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.469179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e648d-7527-4da1-9d9e-d4237852a37d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.470763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 333/658] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:35.471504 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e648d-7527-4da1-9d9e-d4237852a37d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:35.485772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 326/659] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Aug 4 05:06:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:35.487501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f9797-118e-4434-a0bc-f6d0901d361b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:35.582411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:35.589347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:35.593406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e648d-7527-4da1-9d9e-d4237852a37d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:35.603709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f9797-118e-4434-a0bc-f6d0901d361b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:35.631735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec991716-4cb2-4ac4-8f4a-496163d12aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:35.632353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec991716-4cb2-4ac4-8f4a-496163d12aea None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.632631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec991716-4cb2-4ac4-8f4a-496163d12aea None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.633284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec991716-4cb2-4ac4-8f4a-496163d12aea None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.633672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec991716-4cb2-4ac4-8f4a-496163d12aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:35.634010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec991716-4cb2-4ac4-8f4a-496163d12aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:35.634689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcedd0-fad0-43c4-8460-3ace17811b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:35.635330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcedd0-fad0-43c4-8460-3ace17811b1d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.635428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec991716-4cb2-4ac4-8f4a-496163d12aea None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:35.635615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcedd0-fad0-43c4-8460-3ace17811b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.635942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcedd0-fad0-43c4-8460-3ace17811b1d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.644247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcedd0-fad0-43c4-8460-3ace17811b1d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:35.645731 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcedd0-fad0-43c4-8460-3ace17811b1d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:35.653269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 334/660] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:35.653269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda23b5-a4a0-4e18-8948-b8ebc86075eb None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.653269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda23b5-a4a0-4e18-8948-b8ebc86075eb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.653269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda23b5-a4a0-4e18-8948-b8ebc86075eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-72fcedd0-fad0-43c4-8460-3ace17811b1d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:35.665834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:35.672726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 327/661] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:35.673703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcedd0-fad0-43c4-8460-3ace17811b1d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:35.674398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9fda23b5-a4a0-4e18-8948-b8ebc86075eb None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:35.674475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9fda23b5-a4a0-4e18-8948-b8ebc86075eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:35.753053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 335/662] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:35.753983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda23b5-a4a0-4e18-8948-b8ebc86075eb None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:35.789472 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcedd0-fad0-43c4-8460-3ace17811b1d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:35.825174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446799-8c62-4b0b-8ffe-a361c6b81a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:35.825787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446799-8c62-4b0b-8ffe-a361c6b81a58 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.826064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446799-8c62-4b0b-8ffe-a361c6b81a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.826495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446799-8c62-4b0b-8ffe-a361c6b81a58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.857923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:35.873893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:35.893751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda23b5-a4a0-4e18-8948-b8ebc86075eb None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:35.916004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b446799-8c62-4b0b-8ffe-a361c6b81a58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:35.917972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b446799-8c62-4b0b-8ffe-a361c6b81a58 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:35.929547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8b58c-3574-47f4-80c5-2bcc8e1358b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:35.930518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8b58c-3574-47f4-80c5-2bcc8e1358b6 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:35.930798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8b58c-3574-47f4-80c5-2bcc8e1358b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:35.931215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8b58c-3574-47f4-80c5-2bcc8e1358b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:35.939546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8b58c-3574-47f4-80c5-2bcc8e1358b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:35.940993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8b58c-3574-47f4-80c5-2bcc8e1358b6 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-a9c8b58c-3574-47f4-80c5-2bcc8e1358b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:35.953593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:35.954628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:35.955521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:35.955521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:35.955521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:35.955521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:35.955521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:35.955521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:35.955521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:35.955521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:35.955521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 336/663] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:35.955521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8b58c-3574-47f4-80c5-2bcc8e1358b6 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.033341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 328/664] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:36.034604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446799-8c62-4b0b-8ffe-a361c6b81a58 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.072733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8b58c-3574-47f4-80c5-2bcc8e1358b6 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:36.094356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:36.112226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3218a6-600b-4409-997a-e97cb9c08c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:36.112844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3218a6-600b-4409-997a-e97cb9c08c4c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:36.113127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3218a6-600b-4409-997a-e97cb9c08c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:36.113395 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3218a6-600b-4409-997a-e97cb9c08c4c None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:36.114190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3218a6-600b-4409-997a-e97cb9c08c4c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:36.114532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3218a6-600b-4409-997a-e97cb9c08c4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:36.115983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3218a6-600b-4409-997a-e97cb9c08c4c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:36.133695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:36.143641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 337/665] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Aug 4 05:06:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:36.143641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3218a6-600b-4409-997a-e97cb9c08c4c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.153609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446799-8c62-4b0b-8ffe-a361c6b81a58 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:36.189306 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed16e60-4456-4835-bcd5-7b358929cd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:36.190030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16e60-4456-4835-bcd5-7b358929cd2a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:36.190407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16e60-4456-4835-bcd5-7b358929cd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:36.190750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16e60-4456-4835-bcd5-7b358929cd2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:36.203663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed16e60-4456-4835-bcd5-7b358929cd2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-6ed16e60-4456-4835-bcd5-7b358929cd2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:36.209256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:36.210242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:36.211122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 329/666] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:36.211806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed16e60-4456-4835-bcd5-7b358929cd2a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.261351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3218a6-600b-4409-997a-e97cb9c08c4c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:36.298458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088bd88-131d-4813-a0b2-3abe5de307ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:36.299127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088bd88-131d-4813-a0b2-3abe5de307ac None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:36.299409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088bd88-131d-4813-a0b2-3abe5de307ac None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:36.299680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088bd88-131d-4813-a0b2-3abe5de307ac None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:36.300437 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088bd88-131d-4813-a0b2-3abe5de307ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:36.300738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088bd88-131d-4813-a0b2-3abe5de307ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:36.302156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088bd88-131d-4813-a0b2-3abe5de307ac None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:36.314618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 338/667] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:36.315439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088bd88-131d-4813-a0b2-3abe5de307ac None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.329998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed16e60-4456-4835-bcd5-7b358929cd2a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:36.344134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:36.365976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9a3f7-3067-43bb-849c-14c430064c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:36.366659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9a3f7-3067-43bb-849c-14c430064c9c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:36.366936 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9a3f7-3067-43bb-849c-14c430064c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:36.367212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9a3f7-3067-43bb-849c-14c430064c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:36.380663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9a3f7-3067-43bb-849c-14c430064c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:36.380663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9a3f7-3067-43bb-849c-14c430064c9c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:36.381313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-03e9a3f7-3067-43bb-849c-14c430064c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:36.396244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:36.397377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:36.398545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:36.398545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:36.398545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:36.398545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:36.404216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 330/668] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:36.404216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9a3f7-3067-43bb-849c-14c430064c9c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.431748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088bd88-131d-4813-a0b2-3abe5de307ac None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:36.468104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f32f5-0882-42ee-956f-a8b4ba4bf76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:36.468768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f32f5-0882-42ee-956f-a8b4ba4bf76a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:36.469089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f32f5-0882-42ee-956f-a8b4ba4bf76a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:36.469329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f32f5-0882-42ee-956f-a8b4ba4bf76a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:36.509652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9a3f7-3067-43bb-849c-14c430064c9c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:36.544029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef3153-8147-4f7c-8ed5-f8f882693513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:36.544691 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef3153-8147-4f7c-8ed5-f8f882693513 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:36.544965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef3153-8147-4f7c-8ed5-f8f882693513 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:36.545231 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef3153-8147-4f7c-8ed5-f8f882693513 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:36.545940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef3153-8147-4f7c-8ed5-f8f882693513 None admin] RBAC: Adding query filter params (name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:36.546269 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef3153-8147-4f7c-8ed5-f8f882693513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:36.547577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f32f5-0882-42ee-956f-a8b4ba4bf76a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:36.547914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef3153-8147-4f7c-8ed5-f8f882693513 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:36.549026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f32f5-0882-42ee-956f-a8b4ba4bf76a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:36.561547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 331/669] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:36.561547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef3153-8147-4f7c-8ed5-f8f882693513 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.588268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:36.614382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:36.668439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef3153-8147-4f7c-8ed5-f8f882693513 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:36.710938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaf669-8675-4bc4-8e07-37b7d7d75e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:36.711502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf669-8675-4bc4-8e07-37b7d7d75e12 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:36.711780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf669-8675-4bc4-8e07-37b7d7d75e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:36.712052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf669-8675-4bc4-8e07-37b7d7d75e12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:36.712872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaf669-8675-4bc4-8e07-37b7d7d75e12 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=9fc9a884f16149cda246ea9638621296) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:36.713182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaf669-8675-4bc4-8e07-37b7d7d75e12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:36.714714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaf669-8675-4bc4-8e07-37b7d7d75e12 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:36.729359 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 332/670] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:36 2022] GET /identity/v3/role_assignments?user.id=9fc9a884f16149cda246ea9638621296&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:36.729359 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaf669-8675-4bc4-8e07-37b7d7d75e12 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.778892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 339/671] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:36.779871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f32f5-0882-42ee-956f-a8b4ba4bf76a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.860551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:36.874148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaf669-8675-4bc4-8e07-37b7d7d75e12 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:36.903051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f32f5-0882-42ee-956f-a8b4ba4bf76a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:36.931764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bb3ea-3edd-4a49-934c-efb602510e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:36.932398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bb3ea-3edd-4a49-934c-efb602510e7e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:36.932682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bb3ea-3edd-4a49-934c-efb602510e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:36.932957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bb3ea-3edd-4a49-934c-efb602510e7e None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:36.933682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877bb3ea-3edd-4a49-934c-efb602510e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:36.933989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877bb3ea-3edd-4a49-934c-efb602510e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:36.935830 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877bb3ea-3edd-4a49-934c-efb602510e7e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:36.944330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1802b-b3bc-4c5a-908a-51057fb8e93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:36.944887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1802b-b3bc-4c5a-908a-51057fb8e93d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:36.945162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1802b-b3bc-4c5a-908a-51057fb8e93d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:36.945432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1802b-b3bc-4c5a-908a-51057fb8e93d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:36.948582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 333/672] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:36.949716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bb3ea-3edd-4a49-934c-efb602510e7e None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.957021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1802b-b3bc-4c5a-908a-51057fb8e93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:36.958483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1802b-b3bc-4c5a-908a-51057fb8e93d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-59b1802b-b3bc-4c5a-908a-51057fb8e93d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:36.975148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:36.976170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:36.977553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:36.977553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:36.977553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:36.977553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:36.977553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 340/673] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:36.977553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1802b-b3bc-4c5a-908a-51057fb8e93d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:36.997188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:37.083212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bb3ea-3edd-4a49-934c-efb602510e7e None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:37.100451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1802b-b3bc-4c5a-908a-51057fb8e93d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:37.125362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ad499-0345-468b-94ac-139ac6e4acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:37.126433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ad499-0345-468b-94ac-139ac6e4acfc None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.126914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ad499-0345-468b-94ac-139ac6e4acfc None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.127383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ad499-0345-468b-94ac-139ac6e4acfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.139949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ad499-0345-468b-94ac-139ac6e4acfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:37.141727 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ad499-0345-468b-94ac-139ac6e4acfc None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:37.144259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451be63-01fd-4d93-bca1-3d1c79108cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:37.145062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451be63-01fd-4d93-bca1-3d1c79108cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.145337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451be63-01fd-4d93-bca1-3d1c79108cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.145606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451be63-01fd-4d93-bca1-3d1c79108cb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.155074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451be63-01fd-4d93-bca1-3d1c79108cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:37.156649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451be63-01fd-4d93-bca1-3d1c79108cb5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-0a4ad499-0345-468b-94ac-139ac6e4acfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:37.159288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:37.160185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:37.161080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:37.161080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:37.161080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:37.161080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:37.163407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 334/674] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:37.164427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ad499-0345-468b-94ac-139ac6e4acfc None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:37.174853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-1451be63-01fd-4d93-bca1-3d1c79108cb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:37.177170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:37.178038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:37.178995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:37.178995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:37.178995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:37.178995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:37.178995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:37.178995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:37.178995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:37.178995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:37.181086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 341/675] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:37.182147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451be63-01fd-4d93-bca1-3d1c79108cb5 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:37.268385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:37.274082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ad499-0345-468b-94ac-139ac6e4acfc None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:37.305399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451be63-01fd-4d93-bca1-3d1c79108cb5 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:37.318008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dc39a-b3bb-44f0-836e-5dfdd439e031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:37.319328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc39a-b3bb-44f0-836e-5dfdd439e031 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.320279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc39a-b3bb-44f0-836e-5dfdd439e031 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.320790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc39a-b3bb-44f0-836e-5dfdd439e031 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.321977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dc39a-b3bb-44f0-836e-5dfdd439e031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:37.322736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dc39a-b3bb-44f0-836e-5dfdd439e031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:37.325445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dc39a-b3bb-44f0-836e-5dfdd439e031 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:37.345678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 335/676] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:37.347033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dc39a-b3bb-44f0-836e-5dfdd439e031 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:37.349681 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a49ff8-66cc-4ce7-a47a-9b8f913d721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:37.350658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a49ff8-66cc-4ce7-a47a-9b8f913d721c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.351001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a49ff8-66cc-4ce7-a47a-9b8f913d721c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.351341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a49ff8-66cc-4ce7-a47a-9b8f913d721c None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.352940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a49ff8-66cc-4ce7-a47a-9b8f913d721c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:37.352940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a49ff8-66cc-4ce7-a47a-9b8f913d721c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:37.353827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a49ff8-66cc-4ce7-a47a-9b8f913d721c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:37.370980 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 342/677] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:37.370980 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a49ff8-66cc-4ce7-a47a-9b8f913d721c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:37.432160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:37.475203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dc39a-b3bb-44f0-836e-5dfdd439e031 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:37.476074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a49ff8-66cc-4ce7-a47a-9b8f913d721c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:37.509976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:37.511084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d740af-eb0e-4248-acbc-0ed69b162047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:37.512432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d740af-eb0e-4248-acbc-0ed69b162047 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.512758 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d740af-eb0e-4248-acbc-0ed69b162047 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.513035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d740af-eb0e-4248-acbc-0ed69b162047 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.513781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d740af-eb0e-4248-acbc-0ed69b162047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:37.514086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d740af-eb0e-4248-acbc-0ed69b162047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:37.515575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d740af-eb0e-4248-acbc-0ed69b162047 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:37.517576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a582cf-450e-4568-988c-296f3edd620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:37.524062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a582cf-450e-4568-988c-296f3edd620e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.524062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a582cf-450e-4568-988c-296f3edd620e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.524062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a582cf-450e-4568-988c-296f3edd620e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.526886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a582cf-450e-4568-988c-296f3edd620e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:37.528127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 336/678] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:37.528736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d740af-eb0e-4248-acbc-0ed69b162047 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:37.529721 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a582cf-450e-4568-988c-296f3edd620e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-24a582cf-450e-4568-988c-296f3edd620e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:37.546544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:37.547851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:37.548769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:37.548769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:37.548769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:37.548769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:37.548769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:37.548769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:37.548769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:37.548769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:37.548769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:37.548769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:37.550462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 343/679] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:37.551715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e413f48-d17a-46fc-a5d0-da7e651deadd None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.551999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e413f48-d17a-46fc-a5d0-da7e651deadd None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.554555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e413f48-d17a-46fc-a5d0-da7e651deadd None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.555825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 344/680] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:37.556531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e413f48-d17a-46fc-a5d0-da7e651deadd None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:37.648508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d740af-eb0e-4248-acbc-0ed69b162047 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:37.666390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e413f48-d17a-46fc-a5d0-da7e651deadd None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:37.678747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:37.692527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a86a41-7e29-42d0-8d9f-cfbb8618c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:37.695752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86a41-7e29-42d0-8d9f-cfbb8618c689 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.695752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86a41-7e29-42d0-8d9f-cfbb8618c689 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.695752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86a41-7e29-42d0-8d9f-cfbb8618c689 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.702494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a86a41-7e29-42d0-8d9f-cfbb8618c689 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:37.704440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a86a41-7e29-42d0-8d9f-cfbb8618c689 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:37.705027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180cfe-3c36-4586-beeb-db44de1c7268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:37.705645 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180cfe-3c36-4586-beeb-db44de1c7268 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.705918 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180cfe-3c36-4586-beeb-db44de1c7268 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.706193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180cfe-3c36-4586-beeb-db44de1c7268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.707027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180cfe-3c36-4586-beeb-db44de1c7268 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=600993aa29bc452f8658ed8cb426b470) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:37.707316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180cfe-3c36-4586-beeb-db44de1c7268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:37.708718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180cfe-3c36-4586-beeb-db44de1c7268 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:37.714900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 345/681] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:37 2022] GET /identity/v3/role_assignments?user.id=600993aa29bc452f8658ed8cb426b470&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:37.715710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180cfe-3c36-4586-beeb-db44de1c7268 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-46a86a41-7e29-42d0-8d9f-cfbb8618c689 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:37.718333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:37.719304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:37.720185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:37.720185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:37.720185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:37.720185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:37.720185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:37.720185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:37.720185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:37.720185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:37.724527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 337/682] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:37.725974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7c7ec-5e23-4f4e-a6cc-9902ace50857 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.726259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7c7ec-5e23-4f4e-a6cc-9902ace50857 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.726558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7c7ec-5e23-4f4e-a6cc-9902ace50857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.748585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-94f7c7ec-5e23-4f4e-a6cc-9902ace50857 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:37.749891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-94f7c7ec-5e23-4f4e-a6cc-9902ace50857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:37.787817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:37.841083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180cfe-3c36-4586-beeb-db44de1c7268 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:37.866630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 338/683] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:37.867615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7c7ec-5e23-4f4e-a6cc-9902ace50857 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:37.896588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58636080-eef5-4989-81cc-f69d80bd4e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:37.897213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636080-eef5-4989-81cc-f69d80bd4e1b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:37.897490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636080-eef5-4989-81cc-f69d80bd4e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:37.897768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636080-eef5-4989-81cc-f69d80bd4e1b None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:37.898772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58636080-eef5-4989-81cc-f69d80bd4e1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:37.899196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58636080-eef5-4989-81cc-f69d80bd4e1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:37.901206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58636080-eef5-4989-81cc-f69d80bd4e1b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:37.923745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 346/684] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Aug 4 05:06:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:37.924408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58636080-eef5-4989-81cc-f69d80bd4e1b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:38.003669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7c7ec-5e23-4f4e-a6cc-9902ace50857 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:38.027317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:38.047470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58636080-eef5-4989-81cc-f69d80bd4e1b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:38.048819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267396f-42c5-409c-bf6d-c988647a052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:38.049612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267396f-42c5-409c-bf6d-c988647a052e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:38.049889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267396f-42c5-409c-bf6d-c988647a052e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:38.050161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267396f-42c5-409c-bf6d-c988647a052e None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:38.052211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267396f-42c5-409c-bf6d-c988647a052e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:38.052628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267396f-42c5-409c-bf6d-c988647a052e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:38.054073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267396f-42c5-409c-bf6d-c988647a052e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:38.065773 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:38.071516 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 339/685] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:38.072384 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267396f-42c5-409c-bf6d-c988647a052e None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:38.099207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4ed2f-d07f-457b-826b-256c2bd86f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:38.099854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4ed2f-d07f-457b-826b-256c2bd86f0b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:38.100127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4ed2f-d07f-457b-826b-256c2bd86f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:38.100439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4ed2f-d07f-457b-826b-256c2bd86f0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:38.114130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4ed2f-d07f-457b-826b-256c2bd86f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-01e4ed2f-d07f-457b-826b-256c2bd86f0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:38.119642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:38.120794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 347/686] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:38.127291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4ed2f-d07f-457b-826b-256c2bd86f0b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:38.239584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4ed2f-d07f-457b-826b-256c2bd86f0b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:38.282052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ede4-88b5-4b4a-a0f3-829a02dcaa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:38.282716 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ede4-88b5-4b4a-a0f3-829a02dcaa7c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:38.282990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ede4-88b5-4b4a-a0f3-829a02dcaa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:38.283327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ede4-88b5-4b4a-a0f3-829a02dcaa7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:38.284130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7ede4-88b5-4b4a-a0f3-829a02dcaa7c None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=4213a478acfe4cc88df41b3da2d581ee) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:38.284433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7ede4-88b5-4b4a-a0f3-829a02dcaa7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:38.285867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7ede4-88b5-4b4a-a0f3-829a02dcaa7c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:38.298705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 348/687] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:38 2022] GET /identity/v3/role_assignments?user.id=4213a478acfe4cc88df41b3da2d581ee&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:38.300087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ede4-88b5-4b4a-a0f3-829a02dcaa7c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:38.338711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267396f-42c5-409c-bf6d-c988647a052e None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:38.393280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:38.413372 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573f1b8-ad3c-44fd-8815-1d9c3a286eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:38.414396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573f1b8-ad3c-44fd-8815-1d9c3a286eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:38.414862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573f1b8-ad3c-44fd-8815-1d9c3a286eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:38.415319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573f1b8-ad3c-44fd-8815-1d9c3a286eb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:38.468947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:38.508959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573f1b8-ad3c-44fd-8815-1d9c3a286eb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:38.512383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573f1b8-ad3c-44fd-8815-1d9c3a286eb1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:38.515195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ede4-88b5-4b4a-a0f3-829a02dcaa7c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:38.558032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f66643-ecfc-49d3-9756-91de688fa145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:38.559304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66643-ecfc-49d3-9756-91de688fa145 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:38.559304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66643-ecfc-49d3-9756-91de688fa145 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:38.559514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66643-ecfc-49d3-9756-91de688fa145 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:38.560193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f66643-ecfc-49d3-9756-91de688fa145 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:38.560489 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f66643-ecfc-49d3-9756-91de688fa145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:38.561848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f66643-ecfc-49d3-9756-91de688fa145 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:38.571967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 349/688] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:38.578890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f66643-ecfc-49d3-9756-91de688fa145 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:38.651711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 340/689] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:38.658284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573f1b8-ad3c-44fd-8815-1d9c3a286eb1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:38.714332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:38.717769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f66643-ecfc-49d3-9756-91de688fa145 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:38.778680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:38.779385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91280c-41a2-4a8f-a260-fe8ec07ed441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:38.779872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91280c-41a2-4a8f-a260-fe8ec07ed441 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:38.780150 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91280c-41a2-4a8f-a260-fe8ec07ed441 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:38.780421 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91280c-41a2-4a8f-a260-fe8ec07ed441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:38.800538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91280c-41a2-4a8f-a260-fe8ec07ed441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:38.805836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91280c-41a2-4a8f-a260-fe8ec07ed441 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:38.826084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573f1b8-ad3c-44fd-8815-1d9c3a286eb1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-ed91280c-41a2-4a8f-a260-fe8ec07ed441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:38.835530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:38.836510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:38.837397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:38.837397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:38.837397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:38.837397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:38.837397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 350/690] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:38.844781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91280c-41a2-4a8f-a260-fe8ec07ed441 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:38.872691 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b37e43-acaa-4fe6-bac6-0c778719dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:38.873345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b37e43-acaa-4fe6-bac6-0c778719dd80 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:38.873623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b37e43-acaa-4fe6-bac6-0c778719dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:38.873913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b37e43-acaa-4fe6-bac6-0c778719dd80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:38.895215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b37e43-acaa-4fe6-bac6-0c778719dd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:38.896671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b37e43-acaa-4fe6-bac6-0c778719dd80 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-97b37e43-acaa-4fe6-bac6-0c778719dd80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:38.924439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:38.925431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:38.926383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:38.926383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:38.926383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:38.926383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:38.930855 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 341/691] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:38.933213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b37e43-acaa-4fe6-bac6-0c778719dd80 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:39.033277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91280c-41a2-4a8f-a260-fe8ec07ed441 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:39.046788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b37e43-acaa-4fe6-bac6-0c778719dd80 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:39.071390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a342b56-c5e7-4661-b6f9-f67a1a54deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:39.072111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a342b56-c5e7-4661-b6f9-f67a1a54deab None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.072468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a342b56-c5e7-4661-b6f9-f67a1a54deab None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.072824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a342b56-c5e7-4661-b6f9-f67a1a54deab None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.073701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a342b56-c5e7-4661-b6f9-f67a1a54deab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:39.074112 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a342b56-c5e7-4661-b6f9-f67a1a54deab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:39.075760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a342b56-c5e7-4661-b6f9-f67a1a54deab None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:39.078108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:39.091458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32538bf-bb02-41d9-aa36-052ec8c0a397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:39.091915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 351/692] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:39.097675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32538bf-bb02-41d9-aa36-052ec8c0a397 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.097675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32538bf-bb02-41d9-aa36-052ec8c0a397 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.097675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32538bf-bb02-41d9-aa36-052ec8c0a397 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.097675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32538bf-bb02-41d9-aa36-052ec8c0a397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:39.097675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32538bf-bb02-41d9-aa36-052ec8c0a397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:39.097675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32538bf-bb02-41d9-aa36-052ec8c0a397 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:39.098101 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a342b56-c5e7-4661-b6f9-f67a1a54deab None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:39.109878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 342/693] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:39.119653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32538bf-bb02-41d9-aa36-052ec8c0a397 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:39.129352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:39.257540 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32538bf-bb02-41d9-aa36-052ec8c0a397 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:39.266106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a342b56-c5e7-4661-b6f9-f67a1a54deab None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:39.296605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ca479-0e4a-4935-89c0-266a97f155f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:39.297821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ca479-0e4a-4935-89c0-266a97f155f3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.298386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ca479-0e4a-4935-89c0-266a97f155f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.298869 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ca479-0e4a-4935-89c0-266a97f155f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.304644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c2fb4-d947-473d-ba38-e6269199ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:39.305275 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c2fb4-d947-473d-ba38-e6269199ff4b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.305550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c2fb4-d947-473d-ba38-e6269199ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.305911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c2fb4-d947-473d-ba38-e6269199ff4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.307128 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ca479-0e4a-4935-89c0-266a97f155f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:39.309381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ca479-0e4a-4935-89c0-266a97f155f3 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:39.314219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c2fb4-d947-473d-ba38-e6269199ff4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:39.315657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c2fb4-d947-473d-ba38-e6269199ff4b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-804ca479-0e4a-4935-89c0-266a97f155f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:39.321903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:39.322856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:39.323760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:39.323760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:39.323760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:39.323760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:39.323760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:39.323760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:39.323760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:39.323760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:39.326282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 343/694] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:39.327832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b4521-71ca-4f36-b0b5-1e1b6db9e979 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.328373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b4521-71ca-4f36-b0b5-1e1b6db9e979 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.328851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b4521-71ca-4f36-b0b5-1e1b6db9e979 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-dd7c2fb4-d947-473d-ba38-e6269199ff4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:39.334125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:39.335123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:39.336060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:39.336060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:39.336060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:39.336060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:39.336060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:39.336060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:39.336060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:39.336060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:39.336060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:39.336060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:39.337380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 344/696] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:39.338486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 352/696] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 4 05:06:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:39.339094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd64fa5-edc1-4850-a789-b7df0155007c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.339900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd64fa5-edc1-4850-a789-b7df0155007c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.340383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd64fa5-edc1-4850-a789-b7df0155007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.340835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c2fb4-d947-473d-ba38-e6269199ff4b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:39.360342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-1bd64fa5-edc1-4850-a789-b7df0155007c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:39.361997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1bd64fa5-edc1-4850-a789-b7df0155007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:39.407769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:39.420675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:39.438942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 345/697] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:39.447594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd64fa5-edc1-4850-a789-b7df0155007c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:39.453725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c2fb4-d947-473d-ba38-e6269199ff4b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:39.490813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec87668-0ff2-4f38-a9e2-f4dd2c38341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:39.491313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec87668-0ff2-4f38-a9e2-f4dd2c38341e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.491586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec87668-0ff2-4f38-a9e2-f4dd2c38341e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.491855 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec87668-0ff2-4f38-a9e2-f4dd2c38341e None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.492652 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec87668-0ff2-4f38-a9e2-f4dd2c38341e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:39.492945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec87668-0ff2-4f38-a9e2-f4dd2c38341e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:39.494450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec87668-0ff2-4f38-a9e2-f4dd2c38341e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:39.515424 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 353/698] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 4 05:06:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:39.516265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec87668-0ff2-4f38-a9e2-f4dd2c38341e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:39.576071 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd64fa5-edc1-4850-a789-b7df0155007c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:39.613591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e59ce-c64b-498c-96d5-fef601b85232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:39.614595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e59ce-c64b-498c-96d5-fef601b85232 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.615104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e59ce-c64b-498c-96d5-fef601b85232 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.615604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e59ce-c64b-498c-96d5-fef601b85232 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.616555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e59ce-c64b-498c-96d5-fef601b85232 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:39.617065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e59ce-c64b-498c-96d5-fef601b85232 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:39.618826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e59ce-c64b-498c-96d5-fef601b85232 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:39.629492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec87668-0ff2-4f38-a9e2-f4dd2c38341e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:39.637782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 346/699] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:39.639146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e59ce-c64b-498c-96d5-fef601b85232 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:39.661775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:39.674333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b6bf8-e1ae-4153-8953-c3977d538654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:39.674333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b6bf8-e1ae-4153-8953-c3977d538654 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.674333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b6bf8-e1ae-4153-8953-c3977d538654 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.674333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b6bf8-e1ae-4153-8953-c3977d538654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.679245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:39.680498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b6bf8-e1ae-4153-8953-c3977d538654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:39.682060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b6bf8-e1ae-4153-8953-c3977d538654 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-826b6bf8-e1ae-4153-8953-c3977d538654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:39.698876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:39.704922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:39.705810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:39.705810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:39.705810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:39.705810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:39.705810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 354/700] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:39.705810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b6bf8-e1ae-4153-8953-c3977d538654 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:39.755403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e59ce-c64b-498c-96d5-fef601b85232 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:39.794899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae716f4-fc79-4d7b-b331-7f0cce9a0af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:39.796192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae716f4-fc79-4d7b-b331-7f0cce9a0af6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.796622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae716f4-fc79-4d7b-b331-7f0cce9a0af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.797299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae716f4-fc79-4d7b-b331-7f0cce9a0af6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.812726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b6bf8-e1ae-4153-8953-c3977d538654 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:39.850916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808fead-bde2-48de-9da1-39922c9875a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:39.851534 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808fead-bde2-48de-9da1-39922c9875a1 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:39.851808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808fead-bde2-48de-9da1-39922c9875a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:39.852079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808fead-bde2-48de-9da1-39922c9875a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:39.852926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808fead-bde2-48de-9da1-39922c9875a1 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=67ac376400a7466a8e01582efcb91f40) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:39.853228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808fead-bde2-48de-9da1-39922c9875a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:39.854736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808fead-bde2-48de-9da1-39922c9875a1 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:39.862183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 355/701] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:39 2022] GET /identity/v3/role_assignments?user.id=67ac376400a7466a8e01582efcb91f40&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:39.863163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808fead-bde2-48de-9da1-39922c9875a1 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:39.877292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae716f4-fc79-4d7b-b331-7f0cce9a0af6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:39.879150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae716f4-fc79-4d7b-b331-7f0cce9a0af6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:39.916832 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:39.944509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:39.977973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808fead-bde2-48de-9da1-39922c9875a1 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:39.997187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 347/702] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:40.002907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae716f4-fc79-4d7b-b331-7f0cce9a0af6 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:40.070357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f1875-db62-4ed7-8ae3-506502b39c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:40.070999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f1875-db62-4ed7-8ae3-506502b39c5a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.071278 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f1875-db62-4ed7-8ae3-506502b39c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.071548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f1875-db62-4ed7-8ae3-506502b39c5a None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.072252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f1875-db62-4ed7-8ae3-506502b39c5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:40.072554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f1875-db62-4ed7-8ae3-506502b39c5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:40.073947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f1875-db62-4ed7-8ae3-506502b39c5a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:40.105973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 356/703] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:40.112615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73cc09-6e89-4b26-b860-2b30362314c9 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.112805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73cc09-6e89-4b26-b860-2b30362314c9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.113089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73cc09-6e89-4b26-b860-2b30362314c9 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.116502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 357/704] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:40.116677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73cc09-6e89-4b26-b860-2b30362314c9 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:40.119762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae716f4-fc79-4d7b-b331-7f0cce9a0af6 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:40.173930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb059ec-fb90-49a3-acd6-8bb359a61a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:40.174878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb059ec-fb90-49a3-acd6-8bb359a61a50 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.175162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb059ec-fb90-49a3-acd6-8bb359a61a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.175439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb059ec-fb90-49a3-acd6-8bb359a61a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.178291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:40.189542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb059ec-fb90-49a3-acd6-8bb359a61a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:40.191162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb059ec-fb90-49a3-acd6-8bb359a61a50 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-feb059ec-fb90-49a3-acd6-8bb359a61a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:40.210780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:40.211776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:40.212669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:40.212669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:40.212669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:40.212669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:40.213354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 348/705] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:40.214907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006770-8f32-459f-a4c0-9f65f5e7a3eb None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.215345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006770-8f32-459f-a4c0-9f65f5e7a3eb None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.215797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006770-8f32-459f-a4c0-9f65f5e7a3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.241900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b3006770-8f32-459f-a4c0-9f65f5e7a3eb None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:40.243126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b3006770-8f32-459f-a4c0-9f65f5e7a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:40.281062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73cc09-6e89-4b26-b860-2b30362314c9 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:40.291734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:40.319697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 349/706] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:40.320648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3006770-8f32-459f-a4c0-9f65f5e7a3eb None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:40.330037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27c601-3bf9-4a01-8945-52bae15dba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:40.331572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27c601-3bf9-4a01-8945-52bae15dba7c None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.332096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27c601-3bf9-4a01-8945-52bae15dba7c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.332555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27c601-3bf9-4a01-8945-52bae15dba7c None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.333884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27c601-3bf9-4a01-8945-52bae15dba7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:40.336258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27c601-3bf9-4a01-8945-52bae15dba7c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:40.431547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3006770-8f32-459f-a4c0-9f65f5e7a3eb None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:40.450359 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:40.458986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 358/707] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:06:40 2022] POST /identity/v3/users => generated 254 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:40.460990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27c601-3bf9-4a01-8945-52bae15dba7c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:40.498975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da6b8-362d-406f-93bc-c2a340f62604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:40.499671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da6b8-362d-406f-93bc-c2a340f62604 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.500177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da6b8-362d-406f-93bc-c2a340f62604 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.500576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da6b8-362d-406f-93bc-c2a340f62604 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.502634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966da6b8-362d-406f-93bc-c2a340f62604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:40.502947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966da6b8-362d-406f-93bc-c2a340f62604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:40.504807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966da6b8-362d-406f-93bc-c2a340f62604 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:40.534152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 350/708] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:40.546120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da6b8-362d-406f-93bc-c2a340f62604 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:40.659979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27c601-3bf9-4a01-8945-52bae15dba7c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:40.703360 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a89a7-5575-41c5-9ef8-5269f76e5b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:40.703853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da6b8-362d-406f-93bc-c2a340f62604 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:40.703976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a89a7-5575-41c5-9ef8-5269f76e5b4e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.704190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a89a7-5575-41c5-9ef8-5269f76e5b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.704562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a89a7-5575-41c5-9ef8-5269f76e5b4e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.706059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a89a7-5575-41c5-9ef8-5269f76e5b4e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:40.707668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a89a7-5575-41c5-9ef8-5269f76e5b4e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-304a89a7-5575-41c5-9ef8-5269f76e5b4e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:40.721350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:40.722440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:40.723284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 359/709] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Aug 4 05:06:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:40.728808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a89a7-5575-41c5-9ef8-5269f76e5b4e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:40.742326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93568db-5727-45f6-8126-f15e01f2a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:40.742992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93568db-5727-45f6-8126-f15e01f2a992 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.743273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93568db-5727-45f6-8126-f15e01f2a992 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.743551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93568db-5727-45f6-8126-f15e01f2a992 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.751808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93568db-5727-45f6-8126-f15e01f2a992 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:40.753335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93568db-5727-45f6-8126-f15e01f2a992 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:40.765079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-a93568db-5727-45f6-8126-f15e01f2a992 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:40.769459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:40.770371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:40.771273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:40.771273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:40.771273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:40.771273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:40.771273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:40.771273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:40.771273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:40.771273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:40.771273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 351/710] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:40.776626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93568db-5727-45f6-8126-f15e01f2a992 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:40.818765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:40.863289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a89a7-5575-41c5-9ef8-5269f76e5b4e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:40.901357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93568db-5727-45f6-8126-f15e01f2a992 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:40.909137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec66ef3-79b7-4ecf-8e87-8ea7ee31a5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:40.909765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66ef3-79b7-4ecf-8e87-8ea7ee31a5ef None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.910043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66ef3-79b7-4ecf-8e87-8ea7ee31a5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.910338 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66ef3-79b7-4ecf-8e87-8ea7ee31a5ef None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.911027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec66ef3-79b7-4ecf-8e87-8ea7ee31a5ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:40.911384 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec66ef3-79b7-4ecf-8e87-8ea7ee31a5ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:40.912846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec66ef3-79b7-4ecf-8e87-8ea7ee31a5ef None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:40.920202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 360/711] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 4 05:06:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:40.920202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e4090-02cb-4d41-bdbd-6dcb88e73bfb None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.920202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e4090-02cb-4d41-bdbd-6dcb88e73bfb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.920505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e4090-02cb-4d41-bdbd-6dcb88e73bfb None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.921779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 361/712] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:40.928834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e4090-02cb-4d41-bdbd-6dcb88e73bfb None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:40.942562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e81fd-ddf9-4dc9-93d6-98f4fb6f839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:40.943179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e81fd-ddf9-4dc9-93d6-98f4fb6f839a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.943452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e81fd-ddf9-4dc9-93d6-98f4fb6f839a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.943722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e81fd-ddf9-4dc9-93d6-98f4fb6f839a None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.944470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e81fd-ddf9-4dc9-93d6-98f4fb6f839a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:40.944795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e81fd-ddf9-4dc9-93d6-98f4fb6f839a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:40.946297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e81fd-ddf9-4dc9-93d6-98f4fb6f839a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:40.962003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 352/713] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:40.966340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19f7a9-cc04-4ed6-bdf9-cf842369aea4 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:40.966340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19f7a9-cc04-4ed6-bdf9-cf842369aea4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:40.966340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19f7a9-cc04-4ed6-bdf9-cf842369aea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:40.985120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ad19f7a9-cc04-4ed6-bdf9-cf842369aea4 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:40.986332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ad19f7a9-cc04-4ed6-bdf9-cf842369aea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:41.039653 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:41.053652 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e4090-02cb-4d41-bdbd-6dcb88e73bfb None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:41.071036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 353/714] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:41.072148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19f7a9-cc04-4ed6-bdf9-cf842369aea4 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:41.102564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cab07-b605-4f40-b1ee-53fc871b6fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:41.103405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:41.104912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cab07-b605-4f40-b1ee-53fc871b6fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:41.105447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cab07-b605-4f40-b1ee-53fc871b6fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:41.105924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cab07-b605-4f40-b1ee-53fc871b6fa2 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:41.106961 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cab07-b605-4f40-b1ee-53fc871b6fa2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:41.107471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cab07-b605-4f40-b1ee-53fc871b6fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:41.109088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cab07-b605-4f40-b1ee-53fc871b6fa2 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:41.115944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 362/715] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 4 05:06:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:41.117008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cab07-b605-4f40-b1ee-53fc871b6fa2 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:41.237536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19f7a9-cc04-4ed6-bdf9-cf842369aea4 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:41.304710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d69f0c-17c1-44fc-ad62-c061f73e70cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:41.305702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d69f0c-17c1-44fc-ad62-c061f73e70cd None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:41.306178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d69f0c-17c1-44fc-ad62-c061f73e70cd None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:41.306808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d69f0c-17c1-44fc-ad62-c061f73e70cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:41.307914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d69f0c-17c1-44fc-ad62-c061f73e70cd None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=27f7331502484928ba7f8a4b403bdddd) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:41.308224 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d69f0c-17c1-44fc-ad62-c061f73e70cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:41.310442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d69f0c-17c1-44fc-ad62-c061f73e70cd None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:41.322355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 354/716] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:41 2022] GET /identity/v3/role_assignments?user.id=27f7331502484928ba7f8a4b403bdddd&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:41.322589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cab07-b605-4f40-b1ee-53fc871b6fa2 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:41.374756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39ce98-dbc3-44d4-a805-522b2a92a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:41.375419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39ce98-dbc3-44d4-a805-522b2a92a480 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:41.375692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39ce98-dbc3-44d4-a805-522b2a92a480 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:41.375959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39ce98-dbc3-44d4-a805-522b2a92a480 None admin] PATH_INFO: `/v3/services/network` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:41.376605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39ce98-dbc3-44d4-a805-522b2a92a480 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:41.378006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39ce98-dbc3-44d4-a805-522b2a92a480 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-db39ce98-dbc3-44d4-a805-522b2a92a480 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:41.389071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:41.390203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:41.391310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 363/717] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:41 2022] GET /identity/v3/services/network => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:41.397814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d69f0c-17c1-44fc-ad62-c061f73e70cd None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:41.543779 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:41.555182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d69f0c-17c1-44fc-ad62-c061f73e70cd None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:41.593056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1defe22-0105-47c4-848a-545281e61f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:41.594034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1defe22-0105-47c4-848a-545281e61f58 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:41.594603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1defe22-0105-47c4-848a-545281e61f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:41.595086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1defe22-0105-47c4-848a-545281e61f58 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:41.596092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1defe22-0105-47c4-848a-545281e61f58 None admin] RBAC: Adding query filter params (name=network) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:41.596625 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1defe22-0105-47c4-848a-545281e61f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:41.598196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1defe22-0105-47c4-848a-545281e61f58 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:41.603517 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 355/718] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:06:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:41.614366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39ce98-dbc3-44d4-a805-522b2a92a480 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:41.651155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:41.757356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39ce98-dbc3-44d4-a805-522b2a92a480 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:41.798332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3350167-1985-4dfd-8cb2-ad3d01d003e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:41.798874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350167-1985-4dfd-8cb2-ad3d01d003e4 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:41.799147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350167-1985-4dfd-8cb2-ad3d01d003e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:41.799412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350167-1985-4dfd-8cb2-ad3d01d003e4 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:41.800102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3350167-1985-4dfd-8cb2-ad3d01d003e4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:41.800396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3350167-1985-4dfd-8cb2-ad3d01d003e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:41.801826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3350167-1985-4dfd-8cb2-ad3d01d003e4 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:41.807339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 364/719] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:06:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:42.419708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9535-7ed3-410e-bccd-e5cd8f645d1f None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:42.420206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9535-7ed3-410e-bccd-e5cd8f645d1f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:42.420206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9535-7ed3-410e-bccd-e5cd8f645d1f None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:42.421837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 356/720] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:42.427563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7545a-cdd7-439b-ab1d-181b67e6c78d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:42.428415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7545a-cdd7-439b-ab1d-181b67e6c78d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:42.428902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7545a-cdd7-439b-ab1d-181b67e6c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:42.459251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-d4e7545a-cdd7-439b-ab1d-181b67e6c78d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:42.460762 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d4e7545a-cdd7-439b-ab1d-181b67e6c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:42.549608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 365/721] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:42.595795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa9535-7ed3-410e-bccd-e5cd8f645d1f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:42.740089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa9535-7ed3-410e-bccd-e5cd8f645d1f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:42.789952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dadc9e-c3b8-414f-b56a-9a868421d2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:42.791000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dadc9e-c3b8-414f-b56a-9a868421d2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:42.791497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dadc9e-c3b8-414f-b56a-9a868421d2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:42.791979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dadc9e-c3b8-414f-b56a-9a868421d2c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:42.807083 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dadc9e-c3b8-414f-b56a-9a868421d2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-c5dadc9e-c3b8-414f-b56a-9a868421d2c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:42.813074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:42.814088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:42.815266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:42.817679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 357/722] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:42.823353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7545a-cdd7-439b-ab1d-181b67e6c78d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:42.854750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:42.964175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7545a-cdd7-439b-ab1d-181b67e6c78d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:43.017332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac65bfe-2e52-4be8-a3f6-524d449b6367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:43.017865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65bfe-2e52-4be8-a3f6-524d449b6367 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:43.018135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65bfe-2e52-4be8-a3f6-524d449b6367 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:43.018447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65bfe-2e52-4be8-a3f6-524d449b6367 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:43.019162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac65bfe-2e52-4be8-a3f6-524d449b6367 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:43.019458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac65bfe-2e52-4be8-a3f6-524d449b6367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:43.020796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac65bfe-2e52-4be8-a3f6-524d449b6367 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:43.030171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 366/723] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:43.035812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dadc9e-c3b8-414f-b56a-9a868421d2c5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:43.057527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:43.165410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dadc9e-c3b8-414f-b56a-9a868421d2c5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:43.226491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec75b7b-fbd8-41b7-8305-293b0f5c3f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:43.227190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75b7b-fbd8-41b7-8305-293b0f5c3f21 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:43.227469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75b7b-fbd8-41b7-8305-293b0f5c3f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:43.227737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75b7b-fbd8-41b7-8305-293b0f5c3f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:43.246202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec75b7b-fbd8-41b7-8305-293b0f5c3f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:43.248241 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec75b7b-fbd8-41b7-8305-293b0f5c3f21 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:43.257511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a2a00-c970-4974-9e1a-05834ecebe38 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:43.257788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a2a00-c970-4974-9e1a-05834ecebe38 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:43.258052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a2a00-c970-4974-9e1a-05834ecebe38 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:43.259697 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 367/724] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-dec75b7b-fbd8-41b7-8305-293b0f5c3f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:43.270126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:43.271298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:43.272194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:43.272194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:43.272194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:43.272194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:43.273985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 358/725] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:43.280027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ed3d8-b17b-4725-a996-d372d22504ef None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:43.280311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ed3d8-b17b-4725-a996-d372d22504ef None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:43.280580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ed3d8-b17b-4725-a996-d372d22504ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:43.280883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec75b7b-fbd8-41b7-8305-293b0f5c3f21 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:43.313231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-841ed3d8-b17b-4725-a996-d372d22504ef None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:43.314889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-841ed3d8-b17b-4725-a996-d372d22504ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:43.403031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:43.451680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec75b7b-fbd8-41b7-8305-293b0f5c3f21 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:43.481142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 368/726] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:43.498251 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25e83f-2b86-42f8-beb5-23c4449c67c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:43.499259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e83f-2b86-42f8-beb5-23c4449c67c1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:43.499752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e83f-2b86-42f8-beb5-23c4449c67c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:43.500233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e83f-2b86-42f8-beb5-23c4449c67c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:43.501160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25e83f-2b86-42f8-beb5-23c4449c67c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:43.501668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25e83f-2b86-42f8-beb5-23c4449c67c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:43.503267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25e83f-2b86-42f8-beb5-23c4449c67c1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:43.504227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ed3d8-b17b-4725-a996-d372d22504ef None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:43.507429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:43.526204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 359/727] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:43.533931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25e83f-2b86-42f8-beb5-23c4449c67c1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:43.645472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ed3d8-b17b-4725-a996-d372d22504ef None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:43.676655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25e83f-2b86-42f8-beb5-23c4449c67c1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:43.689008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ef306-d30d-4fde-9fba-8534a8156fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:43.689657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ef306-d30d-4fde-9fba-8534a8156fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:43.689933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ef306-d30d-4fde-9fba-8534a8156fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:43.690204 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ef306-d30d-4fde-9fba-8534a8156fa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:43.704053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ef306-d30d-4fde-9fba-8534a8156fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:43.708200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-bd9ef306-d30d-4fde-9fba-8534a8156fa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:43.710282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:43.711262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:43.712126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:43.714381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 369/728] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:43.716430 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b75ea-4d6a-4884-bdcd-0cbc522cacb5 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:43.716879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b75ea-4d6a-4884-bdcd-0cbc522cacb5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:43.717530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b75ea-4d6a-4884-bdcd-0cbc522cacb5 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:43.725753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 370/729] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:43.725753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b75ea-4d6a-4884-bdcd-0cbc522cacb5 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:43.725944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7338f-a223-40c5-8b3d-ad741f247775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:43.725944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7338f-a223-40c5-8b3d-ad741f247775 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:43.726758 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7338f-a223-40c5-8b3d-ad741f247775 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:43.727232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7338f-a223-40c5-8b3d-ad741f247775 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:43.736740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7338f-a223-40c5-8b3d-ad741f247775 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:43.738671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7338f-a223-40c5-8b3d-ad741f247775 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-73d7338f-a223-40c5-8b3d-ad741f247775 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:43.753339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:43.755688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:43.756701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:43.756701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:43.756701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:43.756701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:43.756701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:43.756701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:43.756701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:43.756701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:43.756701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:43.756701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:43.757917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 360/730] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:43.759337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e43a2-3c4e-4f7b-be27-cb273d6dfefa None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:43.759764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e43a2-3c4e-4f7b-be27-cb273d6dfefa None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:43.760183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e43a2-3c4e-4f7b-be27-cb273d6dfefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:43.782277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-881e43a2-3c4e-4f7b-be27-cb273d6dfefa None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:43.783794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-881e43a2-3c4e-4f7b-be27-cb273d6dfefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:43.802765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:43.851914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b75ea-4d6a-4884-bdcd-0cbc522cacb5 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:43.862616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 361/731] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:43.863900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e43a2-3c4e-4f7b-be27-cb273d6dfefa None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:43.908621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a0cc4-0094-4b7a-b5de-d3f8d654abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:43.909625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a0cc4-0094-4b7a-b5de-d3f8d654abbc None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:43.910178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a0cc4-0094-4b7a-b5de-d3f8d654abbc None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:43.910619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a0cc4-0094-4b7a-b5de-d3f8d654abbc None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:43.911539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a0cc4-0094-4b7a-b5de-d3f8d654abbc None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:43.912018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a0cc4-0094-4b7a-b5de-d3f8d654abbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:43.913709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a0cc4-0094-4b7a-b5de-d3f8d654abbc None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:43.926549 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 371/732] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:43.927680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a0cc4-0094-4b7a-b5de-d3f8d654abbc None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:43.987092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e43a2-3c4e-4f7b-be27-cb273d6dfefa None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:44.004408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:44.023201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbcedc-6215-4acd-9767-84f061b0b4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:44.023964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbcedc-6215-4acd-9767-84f061b0b4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.024113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbcedc-6215-4acd-9767-84f061b0b4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.024376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbcedc-6215-4acd-9767-84f061b0b4a2 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.025237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbcedc-6215-4acd-9767-84f061b0b4a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:44.025468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbcedc-6215-4acd-9767-84f061b0b4a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:44.026931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbcedc-6215-4acd-9767-84f061b0b4a2 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:44.044356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a0cc4-0094-4b7a-b5de-d3f8d654abbc None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:44.045752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 362/733] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Aug 4 05:06:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:44.046443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbcedc-6215-4acd-9767-84f061b0b4a2 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:44.076740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:44.085876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30385bf-a369-4202-9da4-84c775ae8c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:44.086598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30385bf-a369-4202-9da4-84c775ae8c93 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.086958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30385bf-a369-4202-9da4-84c775ae8c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.087304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30385bf-a369-4202-9da4-84c775ae8c93 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.087997 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30385bf-a369-4202-9da4-84c775ae8c93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:44.089350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30385bf-a369-4202-9da4-84c775ae8c93 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:44.158078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbcedc-6215-4acd-9767-84f061b0b4a2 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:44.180542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 372/734] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:06:43 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:44.182032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a41a-166d-410f-a4d0-fae9f9d9bd73 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.182299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a41a-166d-410f-a4d0-fae9f9d9bd73 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.182593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a41a-166d-410f-a4d0-fae9f9d9bd73 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.184658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 373/735] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:44.185256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a41a-166d-410f-a4d0-fae9f9d9bd73 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:44.219276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa883-23b4-4ab5-b324-920a978c1c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:44.220628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa883-23b4-4ab5-b324-920a978c1c01 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.221587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa883-23b4-4ab5-b324-920a978c1c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.222384 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa883-23b4-4ab5-b324-920a978c1c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.238513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aa883-23b4-4ab5-b324-920a978c1c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:44.241424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aa883-23b4-4ab5-b324-920a978c1c01 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-133aa883-23b4-4ab5-b324-920a978c1c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:44.264720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:44.265706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:44.266717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:44.266717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:44.266717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:44.266717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:44.266717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 363/736] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:44.268152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09fe84-fb7e-421f-ac11-34b144e425da None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.268536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09fe84-fb7e-421f-ac11-34b144e425da None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.269052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09fe84-fb7e-421f-ac11-34b144e425da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.289619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-cf09fe84-fb7e-421f-ac11-34b144e425da None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:44.290379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cf09fe84-fb7e-421f-ac11-34b144e425da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:44.312256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:44.336854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a41a-166d-410f-a4d0-fae9f9d9bd73 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:44.381077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4e87-fdf5-48ea-8419-d180e60df5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:44.381695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4e87-fdf5-48ea-8419-d180e60df5be None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.381806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 364/737] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:44.382044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4e87-fdf5-48ea-8419-d180e60df5be None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.382339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4e87-fdf5-48ea-8419-d180e60df5be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.383133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09fe84-fb7e-421f-ac11-34b144e425da None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:44.456037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:44.469266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f4e87-fdf5-48ea-8419-d180e60df5be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:44.470738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f4e87-fdf5-48ea-8419-d180e60df5be None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:44.505238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09fe84-fb7e-421f-ac11-34b144e425da None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:44.544760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62600f9b-c989-45a5-a359-44d710f71be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:44.545420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62600f9b-c989-45a5-a359-44d710f71be6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.545741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62600f9b-c989-45a5-a359-44d710f71be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.546024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62600f9b-c989-45a5-a359-44d710f71be6 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.546762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62600f9b-c989-45a5-a359-44d710f71be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:44.547329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62600f9b-c989-45a5-a359-44d710f71be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:44.548733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62600f9b-c989-45a5-a359-44d710f71be6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:44.564970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 365/738] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:44.564970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62600f9b-c989-45a5-a359-44d710f71be6 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:44.578344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:44.586831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 374/739] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 05:06:44.592042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a522d31-62e9-437d-b8a2-1c1dff443a45 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.592042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a522d31-62e9-437d-b8a2-1c1dff443a45 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.592042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a522d31-62e9-437d-b8a2-1c1dff443a45 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.592042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 375/740] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:44.592042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a522d31-62e9-437d-b8a2-1c1dff443a45 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:44.683910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62600f9b-c989-45a5-a359-44d710f71be6 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:44.685384 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:44.702390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a522d31-62e9-437d-b8a2-1c1dff443a45 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:44.726818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696963e0-ed7c-402b-82f6-1f42058e08f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:44.727516 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696963e0-ed7c-402b-82f6-1f42058e08f3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.727802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696963e0-ed7c-402b-82f6-1f42058e08f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.728080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696963e0-ed7c-402b-82f6-1f42058e08f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.738584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696963e0-ed7c-402b-82f6-1f42058e08f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-696963e0-ed7c-402b-82f6-1f42058e08f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:44.743825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:44.744788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:44.745609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:44.748266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44e7e7-cbf1-4791-aba2-52866c30b10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:44.749052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44e7e7-cbf1-4791-aba2-52866c30b10e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.749328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44e7e7-cbf1-4791-aba2-52866c30b10e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.749838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44e7e7-cbf1-4791-aba2-52866c30b10e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.749936 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 366/741] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:44.750726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696963e0-ed7c-402b-82f6-1f42058e08f3 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:44.757259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44e7e7-cbf1-4791-aba2-52866c30b10e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:44.758752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44e7e7-cbf1-4791-aba2-52866c30b10e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-6c44e7e7-cbf1-4791-aba2-52866c30b10e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:44.771850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:44.772854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 376/742] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 4 05:06:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efe306-d345-4738-941b-193dec8ff1c3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.779485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efe306-d345-4738-941b-193dec8ff1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.780353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efe306-d345-4738-941b-193dec8ff1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.797670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-03efe306-d345-4738-941b-193dec8ff1c3 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:44.798885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-03efe306-d345-4738-941b-193dec8ff1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:44.831527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:44.861593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696963e0-ed7c-402b-82f6-1f42058e08f3 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:44.872161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 377/743] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 05:06:44.875283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efe306-d345-4738-941b-193dec8ff1c3 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:44.903569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc01d1-1118-4d48-9c10-9ba9e96dd1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:44.904323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc01d1-1118-4d48-9c10-9ba9e96dd1fd None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:44.904608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc01d1-1118-4d48-9c10-9ba9e96dd1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:44.904988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc01d1-1118-4d48-9c10-9ba9e96dd1fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:44.916627 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc01d1-1118-4d48-9c10-9ba9e96dd1fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:44.918113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc01d1-1118-4d48-9c10-9ba9e96dd1fd None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-8ddc01d1-1118-4d48-9c10-9ba9e96dd1fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:44.935942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:44.937036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:44.938173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:44.938173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:44.938173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:44.938173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:44.941900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 367/744] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:44.942871 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc01d1-1118-4d48-9c10-9ba9e96dd1fd None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:44.958837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:44.982081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efe306-d345-4738-941b-193dec8ff1c3 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:45.018620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adab25d-f776-44f7-ba6b-2ac49b0026af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:45.019316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adab25d-f776-44f7-ba6b-2ac49b0026af None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:45.019502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adab25d-f776-44f7-ba6b-2ac49b0026af None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:45.019771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adab25d-f776-44f7-ba6b-2ac49b0026af None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:45.021161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adab25d-f776-44f7-ba6b-2ac49b0026af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:45.021161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adab25d-f776-44f7-ba6b-2ac49b0026af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:45.022097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adab25d-f776-44f7-ba6b-2ac49b0026af None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:45.030927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 378/745] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:45.031711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adab25d-f776-44f7-ba6b-2ac49b0026af None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:45.057075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc01d1-1118-4d48-9c10-9ba9e96dd1fd None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:45.087667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:45.099272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52be87e-5af1-488f-9abb-9e808e1b6402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:45.099887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52be87e-5af1-488f-9abb-9e808e1b6402 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:45.100166 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52be87e-5af1-488f-9abb-9e808e1b6402 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:45.101137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52be87e-5af1-488f-9abb-9e808e1b6402 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:45.101411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52be87e-5af1-488f-9abb-9e808e1b6402 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:45.101717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52be87e-5af1-488f-9abb-9e808e1b6402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:45.103207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52be87e-5af1-488f-9abb-9e808e1b6402 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:45.120458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 368/746] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Aug 4 05:06:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:45.125816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52be87e-5af1-488f-9abb-9e808e1b6402 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:45.150589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adab25d-f776-44f7-ba6b-2ac49b0026af None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:45.190067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217628b-8fe5-4db7-8f25-9184ff4b5d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:45.190786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217628b-8fe5-4db7-8f25-9184ff4b5d2f None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:45.191147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217628b-8fe5-4db7-8f25-9184ff4b5d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:45.191463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217628b-8fe5-4db7-8f25-9184ff4b5d2f None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:45.192322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217628b-8fe5-4db7-8f25-9184ff4b5d2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:45.193625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217628b-8fe5-4db7-8f25-9184ff4b5d2f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:45.235598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52be87e-5af1-488f-9abb-9e808e1b6402 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:45.269862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637de233-b19e-4389-b987-b0c278295902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:45.270878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:45.271853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637de233-b19e-4389-b987-b0c278295902 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:45.272356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637de233-b19e-4389-b987-b0c278295902 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:45.272829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637de233-b19e-4389-b987-b0c278295902 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:45.273702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637de233-b19e-4389-b987-b0c278295902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:45.274193 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637de233-b19e-4389-b987-b0c278295902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:45.275767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637de233-b19e-4389-b987-b0c278295902 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:45.277129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 379/747] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:06:45 2022] POST /identity/v3/services => generated 240 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:45.287477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217628b-8fe5-4db7-8f25-9184ff4b5d2f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:45.291001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 369/748] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:45.292277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637de233-b19e-4389-b987-b0c278295902 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:45.352542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:45.424031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637de233-b19e-4389-b987-b0c278295902 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:45.462334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217628b-8fe5-4db7-8f25-9184ff4b5d2f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:45.472649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52714-f795-46ba-b58e-0c080fa7bf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:45.473358 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52714-f795-46ba-b58e-0c080fa7bf4f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:45.473708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52714-f795-46ba-b58e-0c080fa7bf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:45.474066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52714-f795-46ba-b58e-0c080fa7bf4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:45.504928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bda849-8471-46ed-801e-d56f01d45852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:45.506470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bda849-8471-46ed-801e-d56f01d45852 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:45.506470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bda849-8471-46ed-801e-d56f01d45852 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:45.506470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bda849-8471-46ed-801e-d56f01d45852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:45.522256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bda849-8471-46ed-801e-d56f01d45852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:45.523733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bda849-8471-46ed-801e-d56f01d45852 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-34bda849-8471-46ed-801e-d56f01d45852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:45.553577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:45.554774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:45.555928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:45.555928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:45.555928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:45.555928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:45.557629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 380/749] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:45.559141 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bda849-8471-46ed-801e-d56f01d45852 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:45.564242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da52714-f795-46ba-b58e-0c080fa7bf4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:45.566225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da52714-f795-46ba-b58e-0c080fa7bf4f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:45.614335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:45.624079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:45.678624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 370/750] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:06:45.679966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52714-f795-46ba-b58e-0c080fa7bf4f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:45.697047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bda849-8471-46ed-801e-d56f01d45852 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:45.746439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ebaa6-41aa-4ecf-8ee3-c116c2c017d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:45.747194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ebaa6-41aa-4ecf-8ee3-c116c2c017d9 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:45.748070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ebaa6-41aa-4ecf-8ee3-c116c2c017d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:45.748432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ebaa6-41aa-4ecf-8ee3-c116c2c017d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:45.757835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ebaa6-41aa-4ecf-8ee3-c116c2c017d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:45.759672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ebaa6-41aa-4ecf-8ee3-c116c2c017d9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-292ebaa6-41aa-4ecf-8ee3-c116c2c017d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:45.779522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:45.780462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:45.781370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:45.781370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:45.781370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:45.781370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:45.781370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:45.781370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:45.781370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:45.781370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:45.781370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 381/751] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:45.781850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ebaa6-41aa-4ecf-8ee3-c116c2c017d9 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:45.799548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52714-f795-46ba-b58e-0c080fa7bf4f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:45.843986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb33479-6bfb-4754-836d-56f1460d92f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:45.845230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb33479-6bfb-4754-836d-56f1460d92f0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:45.846092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb33479-6bfb-4754-836d-56f1460d92f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:45.846579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb33479-6bfb-4754-836d-56f1460d92f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:45.847511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb33479-6bfb-4754-836d-56f1460d92f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:45.848016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb33479-6bfb-4754-836d-56f1460d92f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:45.850435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb33479-6bfb-4754-836d-56f1460d92f0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:45.868785 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 371/752] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:45.869907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb33479-6bfb-4754-836d-56f1460d92f0 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:45.873485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:45.904148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ebaa6-41aa-4ecf-8ee3-c116c2c017d9 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:45.912781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:45.943104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e31332-be36-4189-bee1-c262f1ce29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:45.943874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e31332-be36-4189-bee1-c262f1ce29af None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:45.944229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e31332-be36-4189-bee1-c262f1ce29af None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:45.944885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e31332-be36-4189-bee1-c262f1ce29af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:45.956802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e31332-be36-4189-bee1-c262f1ce29af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:45.958390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e31332-be36-4189-bee1-c262f1ce29af None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-b7e31332-be36-4189-bee1-c262f1ce29af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:45.974814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:45.975784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:45.976737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:45.976737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:45.976737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:45.976737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:45.976737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 382/753] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:45.977682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e31332-be36-4189-bee1-c262f1ce29af None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:46.007420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb33479-6bfb-4754-836d-56f1460d92f0 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:46.054541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39434aa0-6e06-4b9c-b1fc-f89a7b349db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:46.055982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434aa0-6e06-4b9c-b1fc-f89a7b349db1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:46.056483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434aa0-6e06-4b9c-b1fc-f89a7b349db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:46.057237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434aa0-6e06-4b9c-b1fc-f89a7b349db1 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:46.058449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39434aa0-6e06-4b9c-b1fc-f89a7b349db1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:46.059895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39434aa0-6e06-4b9c-b1fc-f89a7b349db1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:46.061555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39434aa0-6e06-4b9c-b1fc-f89a7b349db1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:46.078551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 372/754] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:46.079802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39434aa0-6e06-4b9c-b1fc-f89a7b349db1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:46.094575 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e31332-be36-4189-bee1-c262f1ce29af None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:46.140923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4c86c-6f90-4ba4-b925-90f358a4cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:46.141587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c86c-6f90-4ba4-b925-90f358a4cdec None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:46.142152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c86c-6f90-4ba4-b925-90f358a4cdec None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:46.142486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c86c-6f90-4ba4-b925-90f358a4cdec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:46.153777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4c86c-6f90-4ba4-b925-90f358a4cdec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:46.156535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4c86c-6f90-4ba4-b925-90f358a4cdec None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:46.160467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-e3c4c86c-6f90-4ba4-b925-90f358a4cdec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:46.172706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:46.173920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:46.175108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:46.175108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:46.175108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:46.175108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:46.175108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:46.175108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:46.175108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:46.175108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:46.175108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:46.175108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:46.182093 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 383/755] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 4 05:06:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:46.182093 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4c86c-6f90-4ba4-b925-90f358a4cdec None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:46.203394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:46.224685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39434aa0-6e06-4b9c-b1fc-f89a7b349db1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:46.291873 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c84dd-aeaf-4053-b474-37c270d59bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:46.292722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c84dd-aeaf-4053-b474-37c270d59bcd None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:46.293766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c84dd-aeaf-4053-b474-37c270d59bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:46.294189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c84dd-aeaf-4053-b474-37c270d59bcd None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:46.295134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c84dd-aeaf-4053-b474-37c270d59bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:46.295583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c84dd-aeaf-4053-b474-37c270d59bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:46.297201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4c86c-6f90-4ba4-b925-90f358a4cdec None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:46.301141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c84dd-aeaf-4053-b474-37c270d59bcd None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:46.324577 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 373/756] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:46.325895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c84dd-aeaf-4053-b474-37c270d59bcd None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:46.341665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29df7c-4cff-4a69-b820-d59220cf0c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:46.342538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29df7c-4cff-4a69-b820-d59220cf0c7b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:46.342965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29df7c-4cff-4a69-b820-d59220cf0c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:46.343351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29df7c-4cff-4a69-b820-d59220cf0c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:46.344249 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29df7c-4cff-4a69-b820-d59220cf0c7b None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=67ac376400a7466a8e01582efcb91f40) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:46.344664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29df7c-4cff-4a69-b820-d59220cf0c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:46.346179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29df7c-4cff-4a69-b820-d59220cf0c7b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:46.357932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 384/757] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:46 2022] GET /identity/v3/role_assignments?user.id=67ac376400a7466a8e01582efcb91f40&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:46.357932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29df7c-4cff-4a69-b820-d59220cf0c7b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:46.487517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:46.523897 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c84dd-aeaf-4053-b474-37c270d59bcd None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:46.524170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29df7c-4cff-4a69-b820-d59220cf0c7b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:46.546714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:46.564425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b080b-8d19-40ea-8b6e-f0913c48d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:46.566451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b080b-8d19-40ea-8b6e-f0913c48d75f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:46.566451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b080b-8d19-40ea-8b6e-f0913c48d75f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:46.566451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b080b-8d19-40ea-8b6e-f0913c48d75f None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:46.568585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b080b-8d19-40ea-8b6e-f0913c48d75f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:46.570113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b080b-8d19-40ea-8b6e-f0913c48d75f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:46.573455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b080b-8d19-40ea-8b6e-f0913c48d75f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:46.584714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5d44c-bc69-4953-beda-5b19cda25d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:46.585362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5d44c-bc69-4953-beda-5b19cda25d52 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:46.585672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5d44c-bc69-4953-beda-5b19cda25d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:46.586217 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5d44c-bc69-4953-beda-5b19cda25d52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:46.595869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5d44c-bc69-4953-beda-5b19cda25d52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:46.597811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5d44c-bc69-4953-beda-5b19cda25d52 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:46.604872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 374/758] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 4 05:06:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:46.604872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55856eb6-ea70-4f1b-a98e-5bca19ff95e8 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:46.604872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55856eb6-ea70-4f1b-a98e-5bca19ff95e8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:46.604872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55856eb6-ea70-4f1b-a98e-5bca19ff95e8 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:46.607424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 375/759] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:46.608455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55856eb6-ea70-4f1b-a98e-5bca19ff95e8 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-95d5d44c-bc69-4953-beda-5b19cda25d52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:46.620668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:46.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:46.623444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:46.623444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:46.623444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:46.623444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:46.623444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:46.623444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:46.623444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:46.623444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:46.626388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 385/760] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:46.628426 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c91b-f3b8-4eb1-a4fd-d4079552f0f8 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:46.628854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c91b-f3b8-4eb1-a4fd-d4079552f0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:46.629269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c91b-f3b8-4eb1-a4fd-d4079552f0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:46.653171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-44b2c91b-f3b8-4eb1-a4fd-d4079552f0f8 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:46.657372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-44b2c91b-f3b8-4eb1-a4fd-d4079552f0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:46.776073 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 386/761] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:06:46.777299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2c91b-f3b8-4eb1-a4fd-d4079552f0f8 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:46.799457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55856eb6-ea70-4f1b-a98e-5bca19ff95e8 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:46.883411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b22dd-eb3e-4b66-94eb-aae170dd8ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:46.884718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b22dd-eb3e-4b66-94eb-aae170dd8ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:46.885009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b22dd-eb3e-4b66-94eb-aae170dd8ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:46.885288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b22dd-eb3e-4b66-94eb-aae170dd8ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:46.899088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:46.903745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b22dd-eb3e-4b66-94eb-aae170dd8ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:46.905639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b22dd-eb3e-4b66-94eb-aae170dd8ca7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-9a6b22dd-eb3e-4b66-94eb-aae170dd8ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:46.926002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:46.926986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:46.927851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:46.927851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:46.927851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:46.927851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:46.935105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2c91b-f3b8-4eb1-a4fd-d4079552f0f8 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:46.935380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 376/762] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:46.936480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b22dd-eb3e-4b66-94eb-aae170dd8ca7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:46.969882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:46.986989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71360ff-3b7b-4ed6-83ce-bb2e223d73cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:46.990355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71360ff-3b7b-4ed6-83ce-bb2e223d73cc None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:46.990355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71360ff-3b7b-4ed6-83ce-bb2e223d73cc None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:46.990355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71360ff-3b7b-4ed6-83ce-bb2e223d73cc None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:46.990355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71360ff-3b7b-4ed6-83ce-bb2e223d73cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:46.990355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71360ff-3b7b-4ed6-83ce-bb2e223d73cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:46.991494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71360ff-3b7b-4ed6-83ce-bb2e223d73cc None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:47.007719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 387/763] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:47.008551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71360ff-3b7b-4ed6-83ce-bb2e223d73cc None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:47.049176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b22dd-eb3e-4b66-94eb-aae170dd8ca7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:47.088884 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60805c-c599-4670-b134-762d69b527ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:47.090058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60805c-c599-4670-b134-762d69b527ad None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.090573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60805c-c599-4670-b134-762d69b527ad None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.091133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60805c-c599-4670-b134-762d69b527ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.091977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60805c-c599-4670-b134-762d69b527ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:47.093559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60805c-c599-4670-b134-762d69b527ad None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-3c60805c-c599-4670-b134-762d69b527ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:47.106031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:47.107275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 05:06:47.108124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:47.111249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 377/764] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Aug 4 05:06:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:47.112348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60805c-c599-4670-b134-762d69b527ad None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:47.125977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71360ff-3b7b-4ed6-83ce-bb2e223d73cc None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:47.157378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:47.167059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30d79a-fa07-4cc1-a5ab-7a45f7025284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:47.169294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d79a-fa07-4cc1-a5ab-7a45f7025284 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.169815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d79a-fa07-4cc1-a5ab-7a45f7025284 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.170328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d79a-fa07-4cc1-a5ab-7a45f7025284 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.171235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30d79a-fa07-4cc1-a5ab-7a45f7025284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:47.171740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30d79a-fa07-4cc1-a5ab-7a45f7025284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:47.173622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30d79a-fa07-4cc1-a5ab-7a45f7025284 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:47.187850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 388/765] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:47.189038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30d79a-fa07-4cc1-a5ab-7a45f7025284 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:47.229822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:47.237085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60805c-c599-4670-b134-762d69b527ad None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:47.273401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01242bb-e0ff-43b5-a505-11b73bab6010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:47.274144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01242bb-e0ff-43b5-a505-11b73bab6010 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.274369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01242bb-e0ff-43b5-a505-11b73bab6010 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.274651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01242bb-e0ff-43b5-a505-11b73bab6010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.275445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01242bb-e0ff-43b5-a505-11b73bab6010 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=c6bef167110b40519ff4e31456803b09) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:47.275808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01242bb-e0ff-43b5-a505-11b73bab6010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:47.278126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01242bb-e0ff-43b5-a505-11b73bab6010 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:47.284521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 378/766] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:47 2022] GET /identity/v3/role_assignments?user.id=c6bef167110b40519ff4e31456803b09&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:47.285453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01242bb-e0ff-43b5-a505-11b73bab6010 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:47.309441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30d79a-fa07-4cc1-a5ab-7a45f7025284 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:47.385885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50600de-2988-4be0-b0e8-4765c2778503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:47.387078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50600de-2988-4be0-b0e8-4765c2778503 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.387586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50600de-2988-4be0-b0e8-4765c2778503 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.388062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50600de-2988-4be0-b0e8-4765c2778503 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.388955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50600de-2988-4be0-b0e8-4765c2778503 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:47.389467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50600de-2988-4be0-b0e8-4765c2778503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:47.391248 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50600de-2988-4be0-b0e8-4765c2778503 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:47.405270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01242bb-e0ff-43b5-a505-11b73bab6010 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:47.405633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 389/767] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 4 05:06:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:47.410819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50600de-2988-4be0-b0e8-4765c2778503 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:47.449660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e60f-6c2e-4359-9260-5dbc3c56ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:47.450327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e60f-6c2e-4359-9260-5dbc3c56ade1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.452042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e60f-6c2e-4359-9260-5dbc3c56ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.452321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e60f-6c2e-4359-9260-5dbc3c56ade1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.464465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8e60f-6c2e-4359-9260-5dbc3c56ade1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:47.468270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8e60f-6c2e-4359-9260-5dbc3c56ade1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-96f8e60f-6c2e-4359-9260-5dbc3c56ade1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:47.484437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:47.485383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:47.486301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:47.486301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:47.486301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:47.486301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:47.486301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:47.486301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:47.486301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:47.486301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:47.489480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 379/768] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:47.491448 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:47.496225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e60f-6c2e-4359-9260-5dbc3c56ade1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:47.521345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:47.540691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50600de-2988-4be0-b0e8-4765c2778503 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:47.583412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae908bd8-0c58-4973-94c9-dc11c3820372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:47.584325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae908bd8-0c58-4973-94c9-dc11c3820372 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.584789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae908bd8-0c58-4973-94c9-dc11c3820372 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.585200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae908bd8-0c58-4973-94c9-dc11c3820372 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.586078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae908bd8-0c58-4973-94c9-dc11c3820372 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:47.586577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae908bd8-0c58-4973-94c9-dc11c3820372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:47.588113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae908bd8-0c58-4973-94c9-dc11c3820372 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:47.594790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 390/769] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 4 05:06:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:47.607496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae908bd8-0c58-4973-94c9-dc11c3820372 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:47.612756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e60f-6c2e-4359-9260-5dbc3c56ade1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:47.649086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3b2c2-8c7a-404c-be85-1ce166c23619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:47.649864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3b2c2-8c7a-404c-be85-1ce166c23619 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.650246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3b2c2-8c7a-404c-be85-1ce166c23619 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.650649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3b2c2-8c7a-404c-be85-1ce166c23619 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.651635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3b2c2-8c7a-404c-be85-1ce166c23619 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:47.651979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3b2c2-8c7a-404c-be85-1ce166c23619 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:47.655771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3b2c2-8c7a-404c-be85-1ce166c23619 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:47.666770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 380/770] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:47.668133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f9b1-0793-43ff-a0f9-3d79e4a168e3 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.673491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f9b1-0793-43ff-a0f9-3d79e4a168e3 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.673859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f9b1-0793-43ff-a0f9-3d79e4a168e3 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.675323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 381/771] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:47.676139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2f9b1-0793-43ff-a0f9-3d79e4a168e3 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:47.744584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae908bd8-0c58-4973-94c9-dc11c3820372 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:47.763392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:47.781104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:47.786169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2f9b1-0793-43ff-a0f9-3d79e4a168e3 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:47.787814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd0c65-a0bb-46b3-81d6-6f394d3f73c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:47.789520 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd0c65-a0bb-46b3-81d6-6f394d3f73c9 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.790029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd0c65-a0bb-46b3-81d6-6f394d3f73c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.790586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd0c65-a0bb-46b3-81d6-6f394d3f73c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.791511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd0c65-a0bb-46b3-81d6-6f394d3f73c9 None admin] RBAC: Adding query filter params (interface=public, service_id=ddca9974a8e94f2c9114dfaa95d174b1, region_id=RegionOne) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:47.797297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd0c65-a0bb-46b3-81d6-6f394d3f73c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:47.797297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd0c65-a0bb-46b3-81d6-6f394d3f73c9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:47.805032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 391/772] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 4 05:06:47 2022] GET /identity/v3/endpoints?service_id=ddca9974a8e94f2c9114dfaa95d174b1&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:47.806506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e7fd7-0464-4439-bfb3-f01aa6340316 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.806966 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e7fd7-0464-4439-bfb3-f01aa6340316 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.807444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e7fd7-0464-4439-bfb3-f01aa6340316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.823544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2d2b1-25f3-4819-9b26-000f3190965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:47.825102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d2b1-25f3-4819-9b26-000f3190965c None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:47.825475 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d2b1-25f3-4819-9b26-000f3190965c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:47.825861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d2b1-25f3-4819-9b26-000f3190965c None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/27f7331502484928ba7f8a4b403bdddd/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:47.831411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2d2b1-25f3-4819-9b26-000f3190965c None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=27f7331502484928ba7f8a4b403bdddd, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:47.831411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2d2b1-25f3-4819-9b26-000f3190965c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:47.832481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-791e7fd7-0464-4439-bfb3-f01aa6340316 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:47.834623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-791e7fd7-0464-4439-bfb3-f01aa6340316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:47.915548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 392/773] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:06:47.915548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e7fd7-0464-4439-bfb3-f01aa6340316 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:47.935363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 382/774] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:06:47 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/27f7331502484928ba7f8a4b403bdddd/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:47.947262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2d2b1-25f3-4819-9b26-000f3190965c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:48.072571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2d2b1-25f3-4819-9b26-000f3190965c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:48.104642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e7fd7-0464-4439-bfb3-f01aa6340316 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:48.115992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ed425-573b-4432-bc13-8080576cde72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:48.116996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ed425-573b-4432-bc13-8080576cde72 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:48.117426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ed425-573b-4432-bc13-8080576cde72 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:48.117847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ed425-573b-4432-bc13-8080576cde72 None admin] PATH_INFO: `/v3/services/network` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:48.118753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ed425-573b-4432-bc13-8080576cde72 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:48.121048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ed425-573b-4432-bc13-8080576cde72 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-328ed425-573b-4432-bc13-8080576cde72 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:48.131644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:48.132929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 05:06:48.133888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:48.137208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 383/775] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:47 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:48.143799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ed425-573b-4432-bc13-8080576cde72 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:48.145694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:48.156569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:48.239162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6464a6-7651-4c76-b6c5-58b0bd91e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:48.239985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6464a6-7651-4c76-b6c5-58b0bd91e1ef None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:48.240360 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6464a6-7651-4c76-b6c5-58b0bd91e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:48.240733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6464a6-7651-4c76-b6c5-58b0bd91e1ef None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:48.241503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6464a6-7651-4c76-b6c5-58b0bd91e1ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:48.243078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6464a6-7651-4c76-b6c5-58b0bd91e1ef None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:48.254348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 393/776] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 4 05:06:47 2022] GET /identity/v3/services => generated 772 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:48.293650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ed425-573b-4432-bc13-8080576cde72 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:48.337652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73721680-fdb4-44fc-a947-2798e966e4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:48.338284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73721680-fdb4-44fc-a947-2798e966e4eb None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:48.338592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73721680-fdb4-44fc-a947-2798e966e4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:48.338869 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73721680-fdb4-44fc-a947-2798e966e4eb None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:48.339572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73721680-fdb4-44fc-a947-2798e966e4eb None admin] RBAC: Adding query filter params (name=network) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:48.340438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73721680-fdb4-44fc-a947-2798e966e4eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:48.342000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73721680-fdb4-44fc-a947-2798e966e4eb None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:48.349603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 384/777] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:06:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:48.355497 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6464a6-7651-4c76-b6c5-58b0bd91e1ef None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:48.503405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6464a6-7651-4c76-b6c5-58b0bd91e1ef None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:48.541525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcd419-adad-4747-8adc-7eb6ae45e8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:48.542163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcd419-adad-4747-8adc-7eb6ae45e8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:48.542470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcd419-adad-4747-8adc-7eb6ae45e8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:48.542764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcd419-adad-4747-8adc-7eb6ae45e8b2 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:48.543983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcd419-adad-4747-8adc-7eb6ae45e8b2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:48.544428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcd419-adad-4747-8adc-7eb6ae45e8b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:48.545792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcd419-adad-4747-8adc-7eb6ae45e8b2 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:48.551931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 394/778] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:06:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:48.557686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73721680-fdb4-44fc-a947-2798e966e4eb None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:48.575038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eb9bb-44ec-4609-ab1a-b1617774239b None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:48.575348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eb9bb-44ec-4609-ab1a-b1617774239b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:48.575623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eb9bb-44ec-4609-ab1a-b1617774239b None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:48.577227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 395/779] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:06:48.582228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c2066-e1df-47ea-94ea-0b5b26bfba2c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:48.582669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c2066-e1df-47ea-94ea-0b5b26bfba2c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:48.583040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c2066-e1df-47ea-94ea-0b5b26bfba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:48.604691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ff4c2066-e1df-47ea-94ea-0b5b26bfba2c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:48.611839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ff4c2066-e1df-47ea-94ea-0b5b26bfba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:48.646683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:48.690638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73721680-fdb4-44fc-a947-2798e966e4eb None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:48.708470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:48.749792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 396/780] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:06:48.757695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16998c-ac0d-494d-a72f-5ab8d0d981fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:48.758567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16998c-ac0d-494d-a72f-5ab8d0d981fb None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:48.759030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16998c-ac0d-494d-a72f-5ab8d0d981fb None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:48.759453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16998c-ac0d-494d-a72f-5ab8d0d981fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:48.760357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16998c-ac0d-494d-a72f-5ab8d0d981fb None admin] RBAC: Adding query filter params (interface=public, service_id=3169dc465df34953b64279e3e71060a0, region_id=RegionOne) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:48.760812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16998c-ac0d-494d-a72f-5ab8d0d981fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:48.762968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16998c-ac0d-494d-a72f-5ab8d0d981fb None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:48.771370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 385/781] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 4 05:06:48 2022] GET /identity/v3/endpoints?service_id=3169dc465df34953b64279e3e71060a0&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:48.777053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c2066-e1df-47ea-94ea-0b5b26bfba2c None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:48.789824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16998c-ac0d-494d-a72f-5ab8d0d981fb None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:48.935208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16998c-ac0d-494d-a72f-5ab8d0d981fb None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:48.971186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c2066-e1df-47ea-94ea-0b5b26bfba2c None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:48.986135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:48.999702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1468-898f-4677-9427-5f59ca9e5a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:49.000634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1468-898f-4677-9427-5f59ca9e5a7e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:49.001063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1468-898f-4677-9427-5f59ca9e5a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:49.001502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1468-898f-4677-9427-5f59ca9e5a7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:49.026881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad1468-898f-4677-9427-5f59ca9e5a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-f1ad1468-898f-4677-9427-5f59ca9e5a7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:49.034889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:49.036053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:49.037117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:49.041605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc358a-6ba8-4619-9e60-aea448233fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:49.042568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc358a-6ba8-4619-9e60-aea448233fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:49.043100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc358a-6ba8-4619-9e60-aea448233fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:49.043533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc358a-6ba8-4619-9e60-aea448233fa5 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:49.044342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc358a-6ba8-4619-9e60-aea448233fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:49.045865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc358a-6ba8-4619-9e60-aea448233fa5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:49.046440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 386/782] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:49.047732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1468-898f-4677-9427-5f59ca9e5a7e None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:49.058516 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 397/783] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 4 05:06:48 2022] GET /identity/v3/services => generated 772 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:49.249391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1468-898f-4677-9427-5f59ca9e5a7e None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:49.287696 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db9e88-6aef-45c3-8061-0f36aa8d1494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:49.288324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db9e88-6aef-45c3-8061-0f36aa8d1494 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:49.288609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db9e88-6aef-45c3-8061-0f36aa8d1494 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:49.288885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db9e88-6aef-45c3-8061-0f36aa8d1494 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:49.289609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db9e88-6aef-45c3-8061-0f36aa8d1494 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:49.289915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db9e88-6aef-45c3-8061-0f36aa8d1494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:49.291310 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db9e88-6aef-45c3-8061-0f36aa8d1494 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:49.301695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 387/784] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:49.307188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc358a-6ba8-4619-9e60-aea448233fa5 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:49.346469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:49.421081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc358a-6ba8-4619-9e60-aea448233fa5 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:49.465314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa100dfa-932e-4c33-a504-05a6df5a88f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:49.465965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa100dfa-932e-4c33-a504-05a6df5a88f0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:49.466237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa100dfa-932e-4c33-a504-05a6df5a88f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:49.466673 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa100dfa-932e-4c33-a504-05a6df5a88f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:49.490183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa100dfa-932e-4c33-a504-05a6df5a88f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:49.491653 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa100dfa-932e-4c33-a504-05a6df5a88f0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-aa100dfa-932e-4c33-a504-05a6df5a88f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:49.516365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:49.517276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:49.518165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:49.518165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:49.518165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:49.518165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:49.518165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 398/785] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:49.523114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db9e88-6aef-45c3-8061-0f36aa8d1494 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:49.599373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:49.636464 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ab83-e316-4465-945b-74e43a96c8de None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:49.637439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ab83-e316-4465-945b-74e43a96c8de None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:49.637661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ab83-e316-4465-945b-74e43a96c8de None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:49.642162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 399/786] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:06:49.644615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a60a-ca9e-4fe3-9134-a8fc7c17e234 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:49.644902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a60a-ca9e-4fe3-9134-a8fc7c17e234 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:49.645177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a60a-ca9e-4fe3-9134-a8fc7c17e234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:49.664148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-4b22a60a-ca9e-4fe3-9134-a8fc7c17e234 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:49.664805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db9e88-6aef-45c3-8061-0f36aa8d1494 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:49.665371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4b22a60a-ca9e-4fe3-9134-a8fc7c17e234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:49.750388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 400/787] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:06:49.763286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a60a-ca9e-4fe3-9134-a8fc7c17e234 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:49.771095 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a31cc2-8df7-46fc-b48c-11e2015ab96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:49.771666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a31cc2-8df7-46fc-b48c-11e2015ab96b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:49.771944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a31cc2-8df7-46fc-b48c-11e2015ab96b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:49.772217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a31cc2-8df7-46fc-b48c-11e2015ab96b None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:49.773012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a31cc2-8df7-46fc-b48c-11e2015ab96b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:49.773318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a31cc2-8df7-46fc-b48c-11e2015ab96b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:49.774721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a31cc2-8df7-46fc-b48c-11e2015ab96b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:49.793375 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:49.804282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 388/788] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:49.807793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a31cc2-8df7-46fc-b48c-11e2015ab96b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:49.937182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a60a-ca9e-4fe3-9134-a8fc7c17e234 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:49.940332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a31cc2-8df7-46fc-b48c-11e2015ab96b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:49.964399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:49.979548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386eb44-5882-447d-b11f-5f1f4caf603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:49.980317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386eb44-5882-447d-b11f-5f1f4caf603f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:49.980667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386eb44-5882-447d-b11f-5f1f4caf603f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:49.981013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386eb44-5882-447d-b11f-5f1f4caf603f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:49.989327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386eb44-5882-447d-b11f-5f1f4caf603f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:49.991044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386eb44-5882-447d-b11f-5f1f4caf603f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-8386eb44-5882-447d-b11f-5f1f4caf603f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:50.004459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:50.005634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:50.007418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:50.007418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:50.007418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:50.007418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:50.007418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:50.007418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:50.007418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:50.007418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:50.007418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:50.007418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:50.008715 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 389/789] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:50.019351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386eb44-5882-447d-b11f-5f1f4caf603f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:50.038941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ffe8-9b81-48e4-a4d2-f1717a4cafb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:50.039524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ffe8-9b81-48e4-a4d2-f1717a4cafb2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.039800 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ffe8-9b81-48e4-a4d2-f1717a4cafb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.040073 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ffe8-9b81-48e4-a4d2-f1717a4cafb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.068473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ffe8-9b81-48e4-a4d2-f1717a4cafb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3c55ffe8-9b81-48e4-a4d2-f1717a4cafb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:50.082351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:50.084667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:50.086769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 401/790] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:50.100915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ffe8-9b81-48e4-a4d2-f1717a4cafb2 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:50.135118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386eb44-5882-447d-b11f-5f1f4caf603f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:50.186415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366c52-b229-433e-bc6d-7f858c61fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:50.187393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366c52-b229-433e-bc6d-7f858c61fe81 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.187882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366c52-b229-433e-bc6d-7f858c61fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.188387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366c52-b229-433e-bc6d-7f858c61fe81 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.189415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366c52-b229-433e-bc6d-7f858c61fe81 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:50.189979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366c52-b229-433e-bc6d-7f858c61fe81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:50.195771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366c52-b229-433e-bc6d-7f858c61fe81 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:50.206053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:50.228188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ffe8-9b81-48e4-a4d2-f1717a4cafb2 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:50.236598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 390/791] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Aug 4 05:06:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:50.242530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366c52-b229-433e-bc6d-7f858c61fe81 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:50.273486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e604be-64ae-4811-af50-8968b51e74ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:50.274113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e604be-64ae-4811-af50-8968b51e74ef None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.274421 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e604be-64ae-4811-af50-8968b51e74ef None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.274702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e604be-64ae-4811-af50-8968b51e74ef None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.275425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e604be-64ae-4811-af50-8968b51e74ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:50.275727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e604be-64ae-4811-af50-8968b51e74ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:50.277124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e604be-64ae-4811-af50-8968b51e74ef None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:50.292831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 402/792] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:50.302761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:50.304187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e604be-64ae-4811-af50-8968b51e74ef None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:50.378491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366c52-b229-433e-bc6d-7f858c61fe81 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:50.415059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08518-032d-4e2d-aea6-e6e3569c8c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:50.415705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08518-032d-4e2d-aea6-e6e3569c8c7d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.415987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08518-032d-4e2d-aea6-e6e3569c8c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.416268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08518-032d-4e2d-aea6-e6e3569c8c7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.427604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08518-032d-4e2d-aea6-e6e3569c8c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:50.429065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08518-032d-4e2d-aea6-e6e3569c8c7d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-bdd08518-032d-4e2d-aea6-e6e3569c8c7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:50.445089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:50.446035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:50.446963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:50.446963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:50.446963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:50.446963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:50.446963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 391/793] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:50.455340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08518-032d-4e2d-aea6-e6e3569c8c7d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:50.499998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e604be-64ae-4811-af50-8968b51e74ef None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:50.538018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb0eaa-0b1d-46d2-83d3-c1ac6fe85c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:50.538896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb0eaa-0b1d-46d2-83d3-c1ac6fe85c17 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.539153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb0eaa-0b1d-46d2-83d3-c1ac6fe85c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.539404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb0eaa-0b1d-46d2-83d3-c1ac6fe85c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.550503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:50.553152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb0eaa-0b1d-46d2-83d3-c1ac6fe85c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:50.554745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb0eaa-0b1d-46d2-83d3-c1ac6fe85c17 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:50.569910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3ddb0eaa-0b1d-46d2-83d3-c1ac6fe85c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:50.571795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:50.572661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:50.573932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:50.573932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:50.573932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:50.573932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:50.573932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 403/794] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:50.575815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6059b-d162-4cb3-8921-e3b9fd094af4 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.575815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6059b-d162-4cb3-8921-e3b9fd094af4 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.575815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6059b-d162-4cb3-8921-e3b9fd094af4 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.580930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 404/795] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:50.583850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a00b6-f360-4002-8377-b1c258266173 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.584254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a00b6-f360-4002-8377-b1c258266173 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.584630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a00b6-f360-4002-8377-b1c258266173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.594157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08518-032d-4e2d-aea6-e6e3569c8c7d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:50.605531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0d4a00b6-f360-4002-8377-b1c258266173 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:50.606994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0d4a00b6-f360-4002-8377-b1c258266173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:50.633168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c5f18-f887-46d6-86c6-2e37dc78a78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:50.633790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c5f18-f887-46d6-86c6-2e37dc78a78b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.634071 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c5f18-f887-46d6-86c6-2e37dc78a78b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.634385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c5f18-f887-46d6-86c6-2e37dc78a78b None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.635089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c5f18-f887-46d6-86c6-2e37dc78a78b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:50.635392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c5f18-f887-46d6-86c6-2e37dc78a78b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:50.637442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c5f18-f887-46d6-86c6-2e37dc78a78b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:50.650099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 392/796] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:50.650971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c5f18-f887-46d6-86c6-2e37dc78a78b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:50.694408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 405/797] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:06:50.695583 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a00b6-f360-4002-8377-b1c258266173 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:50.760028 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c5f18-f887-46d6-86c6-2e37dc78a78b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:50.796528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1e68d-e249-4d50-8caa-6ff5b106d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:50.797409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1e68d-e249-4d50-8caa-6ff5b106d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.797688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1e68d-e249-4d50-8caa-6ff5b106d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.797968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1e68d-e249-4d50-8caa-6ff5b106d5f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.798696 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1e68d-e249-4d50-8caa-6ff5b106d5f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:50.799004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1e68d-e249-4d50-8caa-6ff5b106d5f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:50.800428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1e68d-e249-4d50-8caa-6ff5b106d5f0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:50.818521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 393/798] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:50.819371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1e68d-e249-4d50-8caa-6ff5b106d5f0 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:50.823160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:50.827174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a00b6-f360-4002-8377-b1c258266173 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:50.851234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:50.864188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12a9ac-df31-459a-913e-f548805a8c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:50.864827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12a9ac-df31-459a-913e-f548805a8c9d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.865103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12a9ac-df31-459a-913e-f548805a8c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.865374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12a9ac-df31-459a-913e-f548805a8c9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.873125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12a9ac-df31-459a-913e-f548805a8c9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:50.874605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12a9ac-df31-459a-913e-f548805a8c9d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-8d12a9ac-df31-459a-913e-f548805a8c9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:50.886510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:50.888724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:50.890860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:50.890860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:50.890860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:50.890860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:50.890860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:50.890860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:50.890860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:50.890860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:50.897843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 406/799] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:50.897843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12a9ac-df31-459a-913e-f548805a8c9d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:50.930723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1e68d-e249-4d50-8caa-6ff5b106d5f0 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:50.966788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd045b-259f-44c1-899e-8f6f07f9edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:50.967449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd045b-259f-44c1-899e-8f6f07f9edaf None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:50.967742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd045b-259f-44c1-899e-8f6f07f9edaf None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:50.968041 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd045b-259f-44c1-899e-8f6f07f9edaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:50.979443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd045b-259f-44c1-899e-8f6f07f9edaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-44fd045b-259f-44c1-899e-8f6f07f9edaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:50.985580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:50.987984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 394/800] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:50.990015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd045b-259f-44c1-899e-8f6f07f9edaf None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:51.006125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12a9ac-df31-459a-913e-f548805a8c9d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:51.042779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e6087-5e48-4105-b68c-126f36b45cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:51.044060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e6087-5e48-4105-b68c-126f36b45cbd None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.044431 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e6087-5e48-4105-b68c-126f36b45cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.044630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e6087-5e48-4105-b68c-126f36b45cbd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.053670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e6087-5e48-4105-b68c-126f36b45cbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:51.054140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:51.056381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e6087-5e48-4105-b68c-126f36b45cbd None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-771e6087-5e48-4105-b68c-126f36b45cbd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:51.068873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:51.069889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:51.070856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:51.070856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:51.070856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:51.070856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:51.070856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:51.070856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:51.070856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:51.070856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:51.070856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:06:51.070856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:51.073397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 407/801] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 4 05:06:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:51.074710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e6087-5e48-4105-b68c-126f36b45cbd None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:51.100379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd045b-259f-44c1-899e-8f6f07f9edaf None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:51.122391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:51.141946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623efbdb-aaad-49d9-bb0d-e67902da1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:51.142716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623efbdb-aaad-49d9-bb0d-e67902da1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.143000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623efbdb-aaad-49d9-bb0d-e67902da1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.143277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623efbdb-aaad-49d9-bb0d-e67902da1cd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.144032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623efbdb-aaad-49d9-bb0d-e67902da1cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:51.144344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623efbdb-aaad-49d9-bb0d-e67902da1cd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:51.145867 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623efbdb-aaad-49d9-bb0d-e67902da1cd4 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:51.172190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 395/802] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:51.173495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a65f7-6335-4df7-a5d4-2cb3643fd395 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.173806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a65f7-6335-4df7-a5d4-2cb3643fd395 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.174069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a65f7-6335-4df7-a5d4-2cb3643fd395 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.175449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 396/803] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:51.176086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a65f7-6335-4df7-a5d4-2cb3643fd395 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:51.194498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e6087-5e48-4105-b68c-126f36b45cbd None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:51.234235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8e544-8e5e-42fc-b600-72204e272875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:51.234874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8e544-8e5e-42fc-b600-72204e272875 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.235449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8e544-8e5e-42fc-b600-72204e272875 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.235449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8e544-8e5e-42fc-b600-72204e272875 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.236103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8e544-8e5e-42fc-b600-72204e272875 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:51.236405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8e544-8e5e-42fc-b600-72204e272875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:51.237753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8e544-8e5e-42fc-b600-72204e272875 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:51.251768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 408/804] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:51.251768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8e544-8e5e-42fc-b600-72204e272875 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:51.290956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a65f7-6335-4df7-a5d4-2cb3643fd395 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:51.317676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:51.331356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c648b-867e-4c7d-9bf8-4dfa60209f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:51.331356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c648b-867e-4c7d-9bf8-4dfa60209f38 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.331356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c648b-867e-4c7d-9bf8-4dfa60209f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.331356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c648b-867e-4c7d-9bf8-4dfa60209f38 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.331757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c648b-867e-4c7d-9bf8-4dfa60209f38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:51.331999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c648b-867e-4c7d-9bf8-4dfa60209f38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:51.333493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c648b-867e-4c7d-9bf8-4dfa60209f38 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:51.358206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 397/805] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Aug 4 05:06:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:51.358206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13794a-98f0-429f-a648-298796f0720f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.358206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13794a-98f0-429f-a648-298796f0720f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.358206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13794a-98f0-429f-a648-298796f0720f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.368096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8e544-8e5e-42fc-b600-72204e272875 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:51.372504 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:51.374225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9e13794a-98f0-429f-a648-298796f0720f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:51.375638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9e13794a-98f0-429f-a648-298796f0720f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:51.410805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c083ad-069d-427e-858c-62782ec73cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:51.411480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c083ad-069d-427e-858c-62782ec73cdb None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.411759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c083ad-069d-427e-858c-62782ec73cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.412023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c083ad-069d-427e-858c-62782ec73cdb None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/67ac376400a7466a8e01582efcb91f40/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.413970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c083ad-069d-427e-858c-62782ec73cdb None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=67ac376400a7466a8e01582efcb91f40, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:51.415413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c083ad-069d-427e-858c-62782ec73cdb None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:51.460288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 398/806] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:06:51.461260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13794a-98f0-429f-a648-298796f0720f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:51.499029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 409/807] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:06:51 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/67ac376400a7466a8e01582efcb91f40/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:51.500655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c083ad-069d-427e-858c-62782ec73cdb None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:51.616822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13794a-98f0-429f-a648-298796f0720f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:51.633392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:51.643414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c083ad-069d-427e-858c-62782ec73cdb None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:51.658674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a7566-902c-492d-b6ae-ddf818c6aa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:51.659322 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a7566-902c-492d-b6ae-ddf818c6aa9b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.659601 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a7566-902c-492d-b6ae-ddf818c6aa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.660184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a7566-902c-492d-b6ae-ddf818c6aa9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.673805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a7566-902c-492d-b6ae-ddf818c6aa9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:51.675454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a7566-902c-492d-b6ae-ddf818c6aa9b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:51.688675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24672e1b-5c6a-416d-90d0-c4b90bf538c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:51.689320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24672e1b-5c6a-416d-90d0-c4b90bf538c1 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.689598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24672e1b-5c6a-416d-90d0-c4b90bf538c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.689875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24672e1b-5c6a-416d-90d0-c4b90bf538c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-ad5a7566-902c-492d-b6ae-ddf818c6aa9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:51.699624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:51.700578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:51.701545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:51.701545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:51.701545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:51.701545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:51.701545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 399/808] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:51.701545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a7566-902c-492d-b6ae-ddf818c6aa9b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:51.706701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24672e1b-5c6a-416d-90d0-c4b90bf538c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:51.708262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24672e1b-5c6a-416d-90d0-c4b90bf538c1 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-24672e1b-5c6a-416d-90d0-c4b90bf538c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:51.725528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:51.726515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:51.727501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:51.727501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:51.727501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:51.727501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:51.727501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 410/809] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:51.728375 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0f120-321e-4222-88b5-f9d8517d937c None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.728477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0f120-321e-4222-88b5-f9d8517d937c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.728721 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0f120-321e-4222-88b5-f9d8517d937c None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.730129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 411/810] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:51.731435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0f120-321e-4222-88b5-f9d8517d937c None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:51.755647 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:51.833626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a7566-902c-492d-b6ae-ddf818c6aa9b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:51.847468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0f120-321e-4222-88b5-f9d8517d937c None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:51.874154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108d09e-bb74-43e5-83c1-17dc6a8ebd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:51.874844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d09e-bb74-43e5-83c1-17dc6a8ebd98 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.875125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d09e-bb74-43e5-83c1-17dc6a8ebd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.875402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d09e-bb74-43e5-83c1-17dc6a8ebd98 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.876040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108d09e-bb74-43e5-83c1-17dc6a8ebd98 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:51.877399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108d09e-bb74-43e5-83c1-17dc6a8ebd98 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:51.886530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4544492-9f76-45c1-8d6c-b63f792820bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-5108d09e-bb74-43e5-83c1-17dc6a8ebd98 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:51.887061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:51.888100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 05:06:51.888948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:51.889765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4544492-9f76-45c1-8d6c-b63f792820bd None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.889765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4544492-9f76-45c1-8d6c-b63f792820bd None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.889765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4544492-9f76-45c1-8d6c-b63f792820bd None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.889765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4544492-9f76-45c1-8d6c-b63f792820bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:51.889765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4544492-9f76-45c1-8d6c-b63f792820bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:51.890677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4544492-9f76-45c1-8d6c-b63f792820bd None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:51.893240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 400/811] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Aug 4 05:06:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:51.894568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aa6e5-3730-42ea-bea0-a1ac2fee3673 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:51.894857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aa6e5-3730-42ea-bea0-a1ac2fee3673 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:51.895134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aa6e5-3730-42ea-bea0-a1ac2fee3673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:51.909840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 412/812] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:51.909840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4544492-9f76-45c1-8d6c-b63f792820bd None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:51.915664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-828aa6e5-3730-42ea-bea0-a1ac2fee3673 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:51.916975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-828aa6e5-3730-42ea-bea0-a1ac2fee3673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:51.943994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:51.993113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 401/813] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:06:51.994278 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aa6e5-3730-42ea-bea0-a1ac2fee3673 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:52.008342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:52.032538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4544492-9f76-45c1-8d6c-b63f792820bd None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.069563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf939-0e86-4951-8337-38ae6006048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.070176 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf939-0e86-4951-8337-38ae6006048c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.070484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf939-0e86-4951-8337-38ae6006048c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.070756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf939-0e86-4951-8337-38ae6006048c None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:52.071471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf939-0e86-4951-8337-38ae6006048c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:52.071821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf939-0e86-4951-8337-38ae6006048c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:52.073201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf939-0e86-4951-8337-38ae6006048c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:52.091054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 413/814] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:52.091054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf939-0e86-4951-8337-38ae6006048c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:52.128674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aa6e5-3730-42ea-bea0-a1ac2fee3673 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.173582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ecd5d-0f70-417b-81e6-2a89704687c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.174298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ecd5d-0f70-417b-81e6-2a89704687c4 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.174679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ecd5d-0f70-417b-81e6-2a89704687c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.175027 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ecd5d-0f70-417b-81e6-2a89704687c4 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:52.175792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ecd5d-0f70-417b-81e6-2a89704687c4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:52.176166 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ecd5d-0f70-417b-81e6-2a89704687c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:52.177615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ecd5d-0f70-417b-81e6-2a89704687c4 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:52.188240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 402/815] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 4 05:06:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:52.188240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ecd5d-0f70-417b-81e6-2a89704687c4 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:52.210289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf939-0e86-4951-8337-38ae6006048c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.213550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:52.246701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb85c03-07ed-4053-88a0-07a74ffd4126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.247317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb85c03-07ed-4053-88a0-07a74ffd4126 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.247596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb85c03-07ed-4053-88a0-07a74ffd4126 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.247879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb85c03-07ed-4053-88a0-07a74ffd4126 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:52.250894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:52.256200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb85c03-07ed-4053-88a0-07a74ffd4126 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:52.257634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb85c03-07ed-4053-88a0-07a74ffd4126 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-8bb85c03-07ed-4053-88a0-07a74ffd4126 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:52.270942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:52.272265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 414/816] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 4 05:06:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:52.273335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb85c03-07ed-4053-88a0-07a74ffd4126 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:52.301622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ecd5d-0f70-417b-81e6-2a89704687c4 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.352185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fbb1a-0784-4996-8e67-d00999e51b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.352819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fbb1a-0784-4996-8e67-d00999e51b5b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.353229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fbb1a-0784-4996-8e67-d00999e51b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.353699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fbb1a-0784-4996-8e67-d00999e51b5b None admin] PATH_INFO: `/v3/services/network` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:52.354594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fbb1a-0784-4996-8e67-d00999e51b5b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:52.356471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fbb1a-0784-4996-8e67-d00999e51b5b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-c98fbb1a-0784-4996-8e67-d00999e51b5b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:52.367537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:52.368635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:52.369513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 403/817] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:52 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:52.371851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fbb1a-0784-4996-8e67-d00999e51b5b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:52.402901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb85c03-07ed-4053-88a0-07a74ffd4126 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.443246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cea534-7143-4d6a-b26a-ebc101fa2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.444141 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cea534-7143-4d6a-b26a-ebc101fa2cee None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.444419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cea534-7143-4d6a-b26a-ebc101fa2cee None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.444740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cea534-7143-4d6a-b26a-ebc101fa2cee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:52.455224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cea534-7143-4d6a-b26a-ebc101fa2cee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:52.456692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cea534-7143-4d6a-b26a-ebc101fa2cee None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:52.466949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-91cea534-7143-4d6a-b26a-ebc101fa2cee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:52.468906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:52.469849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:52.470746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:52.470746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:52.470746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:52.470746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:52.470746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:52.470746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:52.470746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:52.470746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:52.470746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 415/818] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:52.471243 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cea534-7143-4d6a-b26a-ebc101fa2cee None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:52.488612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fbb1a-0784-4996-8e67-d00999e51b5b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.527600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b7fa8-e9a8-4f4a-b11c-d975fc87ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.528475 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b7fa8-e9a8-4f4a-b11c-d975fc87ba0a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.528754 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b7fa8-e9a8-4f4a-b11c-d975fc87ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.529038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b7fa8-e9a8-4f4a-b11c-d975fc87ba0a None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:52.529721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b7fa8-e9a8-4f4a-b11c-d975fc87ba0a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:52.530025 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b7fa8-e9a8-4f4a-b11c-d975fc87ba0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:52.531433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b7fa8-e9a8-4f4a-b11c-d975fc87ba0a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:52.537787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 404/819] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Aug 4 05:06:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:52.538095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:52.539929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b7fa8-e9a8-4f4a-b11c-d975fc87ba0a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:52.586744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cea534-7143-4d6a-b26a-ebc101fa2cee None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.625274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc7b57-b4db-4afd-8d10-a55246da6048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.625891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7b57-b4db-4afd-8d10-a55246da6048 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.626168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7b57-b4db-4afd-8d10-a55246da6048 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.626487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7b57-b4db-4afd-8d10-a55246da6048 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:52.627279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc7b57-b4db-4afd-8d10-a55246da6048 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:52.627582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc7b57-b4db-4afd-8d10-a55246da6048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:52.629153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc7b57-b4db-4afd-8d10-a55246da6048 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:52.647738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 416/820] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 4 05:06:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:52.648564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc7b57-b4db-4afd-8d10-a55246da6048 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:52.663413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b7fa8-e9a8-4f4a-b11c-d975fc87ba0a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.700916 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d136502-fa20-47e4-a9f1-9f4dcf18ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.701845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136502-fa20-47e4-a9f1-9f4dcf18ef5e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.702331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136502-fa20-47e4-a9f1-9f4dcf18ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.702751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136502-fa20-47e4-a9f1-9f4dcf18ef5e None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:52.703599 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d136502-fa20-47e4-a9f1-9f4dcf18ef5e None admin] RBAC: Adding query filter params (name=network) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:52.704055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d136502-fa20-47e4-a9f1-9f4dcf18ef5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:52.705800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d136502-fa20-47e4-a9f1-9f4dcf18ef5e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:52.711257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 405/821] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:06:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:52.711981 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d136502-fa20-47e4-a9f1-9f4dcf18ef5e None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:52.739011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:52.765953 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc7b57-b4db-4afd-8d10-a55246da6048 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.780090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:52.802458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db147f9f-2089-4d9f-984b-2b081c3dba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.803072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147f9f-2089-4d9f-984b-2b081c3dba24 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.803349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147f9f-2089-4d9f-984b-2b081c3dba24 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.803621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147f9f-2089-4d9f-984b-2b081c3dba24 None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:52.804361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db147f9f-2089-4d9f-984b-2b081c3dba24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:52.804668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db147f9f-2089-4d9f-984b-2b081c3dba24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:52.806115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db147f9f-2089-4d9f-984b-2b081c3dba24 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:52.823643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 417/822] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:52.823643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db147f9f-2089-4d9f-984b-2b081c3dba24 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:52.833402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d136502-fa20-47e4-a9f1-9f4dcf18ef5e None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.873886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0a68-3ec7-46e5-a3ee-86aa01bb99d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.875252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0a68-3ec7-46e5-a3ee-86aa01bb99d5 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.875682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0a68-3ec7-46e5-a3ee-86aa01bb99d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.876127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0a68-3ec7-46e5-a3ee-86aa01bb99d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:52.876976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e0a68-3ec7-46e5-a3ee-86aa01bb99d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:52.878510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e0a68-3ec7-46e5-a3ee-86aa01bb99d5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:52.929614 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db147f9f-2089-4d9f-984b-2b081c3dba24 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:52.963713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b95163-6ff7-442a-b88a-d46ea2922b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:52.964321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b95163-6ff7-442a-b88a-d46ea2922b0d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:52.965184 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b95163-6ff7-442a-b88a-d46ea2922b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:52.965954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b95163-6ff7-442a-b88a-d46ea2922b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:53.005923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 406/823] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:06:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:53.006992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0a68-3ec7-46e5-a3ee-86aa01bb99d5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:53.010026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:53.040004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b95163-6ff7-442a-b88a-d46ea2922b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:53.041583 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b95163-6ff7-442a-b88a-d46ea2922b0d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:53.119624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:53.174127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0a68-3ec7-46e5-a3ee-86aa01bb99d5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:53.204838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 418/824] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:06:53.204838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b95163-6ff7-442a-b88a-d46ea2922b0d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:53.227278 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc2c6-fefb-4b40-b826-a3b9fad57cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:53.227918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc2c6-fefb-4b40-b826-a3b9fad57cae None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:53.228198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc2c6-fefb-4b40-b826-a3b9fad57cae None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:53.228472 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc2c6-fefb-4b40-b826-a3b9fad57cae None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:53.229158 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc2c6-fefb-4b40-b826-a3b9fad57cae None admin] RBAC: Adding query filter params (type=network) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:53.229462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc2c6-fefb-4b40-b826-a3b9fad57cae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:53.231412 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc2c6-fefb-4b40-b826-a3b9fad57cae None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:53.239744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 407/825] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:06:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:53.240771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc2c6-fefb-4b40-b826-a3b9fad57cae None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:53.298339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:53.333510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b95163-6ff7-442a-b88a-d46ea2922b0d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:53.380203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc2c6-fefb-4b40-b826-a3b9fad57cae None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:53.380951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b27c-f8b5-43d2-9de3-92d519e7dbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:53.382154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b27c-f8b5-43d2-9de3-92d519e7dbf5 None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:53.382712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b27c-f8b5-43d2-9de3-92d519e7dbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:53.384234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b27c-f8b5-43d2-9de3-92d519e7dbf5 None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/c6bef167110b40519ff4e31456803b09/roles/16ee851075b24775bcb2377722b5adb4` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:53.406758 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b27c-f8b5-43d2-9de3-92d519e7dbf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=c6bef167110b40519ff4e31456803b09, role_id=16ee851075b24775bcb2377722b5adb4)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:53.408270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b27c-f8b5-43d2-9de3-92d519e7dbf5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:53.417621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:53.424269 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d5017-7129-42c4-8328-45f955bed892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:53.424990 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d5017-7129-42c4-8328-45f955bed892 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:53.425275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d5017-7129-42c4-8328-45f955bed892 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:53.425548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d5017-7129-42c4-8328-45f955bed892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:53.436798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d5017-7129-42c4-8328-45f955bed892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:53.438253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d5017-7129-42c4-8328-45f955bed892 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-b48d5017-7129-42c4-8328-45f955bed892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:53.453527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:53.454496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:53.460032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:53.460032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:53.460032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:53.460032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:53.460032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 408/826] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:53.460032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d5017-7129-42c4-8328-45f955bed892 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:53.499418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 419/827] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:06:53 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/c6bef167110b40519ff4e31456803b09/roles/16ee851075b24775bcb2377722b5adb4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:06:53.500777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b27c-f8b5-43d2-9de3-92d519e7dbf5 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:53.594619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d5017-7129-42c4-8328-45f955bed892 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:53.645079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e9443-4aa5-4212-b551-378c67b4976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:53.646089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e9443-4aa5-4212-b551-378c67b4976d None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:53.646690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e9443-4aa5-4212-b551-378c67b4976d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:53.647263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e9443-4aa5-4212-b551-378c67b4976d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:53.648218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e9443-4aa5-4212-b551-378c67b4976d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:53.649996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e9443-4aa5-4212-b551-378c67b4976d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:53.661756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b27c-f8b5-43d2-9de3-92d519e7dbf5 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:53.690252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:53.703711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b4879-96ae-41cc-8980-e541c8e7f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:53.705323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b4879-96ae-41cc-8980-e541c8e7f93e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:53.705596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b4879-96ae-41cc-8980-e541c8e7f93e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:53.705864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b4879-96ae-41cc-8980-e541c8e7f93e None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:53.706591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b4879-96ae-41cc-8980-e541c8e7f93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:53.706887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b4879-96ae-41cc-8980-e541c8e7f93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:53.709124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b4879-96ae-41cc-8980-e541c8e7f93e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:53.728978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 420/828] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:53.728978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb32a4-47da-4a78-83f4-8019fda2250e None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:53.728978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb32a4-47da-4a78-83f4-8019fda2250e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:53.728978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb32a4-47da-4a78-83f4-8019fda2250e None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:53.728978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 421/829] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:53.731365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb32a4-47da-4a78-83f4-8019fda2250e None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:53.770750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 409/830] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:06:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:53.772240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e69ca-1c6f-44dc-820f-5028f70a7474 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:53.772599 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e69ca-1c6f-44dc-820f-5028f70a7474 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:53.772938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e69ca-1c6f-44dc-820f-5028f70a7474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:53.810521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-7d0e69ca-1c6f-44dc-820f-5028f70a7474 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:53.812016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7d0e69ca-1c6f-44dc-820f-5028f70a7474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:53.878606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb32a4-47da-4a78-83f4-8019fda2250e None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:53.882074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:53.947245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 410/831] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:06:53.952189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc440d-c25a-4c76-a7c3-95d24b6a0fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:53.953440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc440d-c25a-4c76-a7c3-95d24b6a0fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:53.953901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc440d-c25a-4c76-a7c3-95d24b6a0fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:53.954404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc440d-c25a-4c76-a7c3-95d24b6a0fa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:53.962368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc440d-c25a-4c76-a7c3-95d24b6a0fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:53.964273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc440d-c25a-4c76-a7c3-95d24b6a0fa7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3cfc440d-c25a-4c76-a7c3-95d24b6a0fa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:53.977805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:53.979026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:53.980165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:53.980165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:53.980165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:53.980165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:53.980165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:53.980165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:53.980165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:53.980165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:53.983444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 422/832] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:53.989061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e69ca-1c6f-44dc-820f-5028f70a7474 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:53.993843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc440d-c25a-4c76-a7c3-95d24b6a0fa7 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:54.054902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:54.116273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e69ca-1c6f-44dc-820f-5028f70a7474 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:54.131647 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc440d-c25a-4c76-a7c3-95d24b6a0fa7 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:54.163545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3ec6-f157-40fd-8fef-536f7cdd1fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:54.165212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3ec6-f157-40fd-8fef-536f7cdd1fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:54.165944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3ec6-f157-40fd-8fef-536f7cdd1fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:54.166419 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3ec6-f157-40fd-8fef-536f7cdd1fa0 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:54.167671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b3ec6-f157-40fd-8fef-536f7cdd1fa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:54.169322 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b3ec6-f157-40fd-8fef-536f7cdd1fa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:54.171438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b3ec6-f157-40fd-8fef-536f7cdd1fa0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:54.182486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701ae1b-b2ac-41a7-bca5-a22ca685c82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:54.183269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701ae1b-b2ac-41a7-bca5-a22ca685c82b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:54.183646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701ae1b-b2ac-41a7-bca5-a22ca685c82b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:54.184000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701ae1b-b2ac-41a7-bca5-a22ca685c82b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:54.191753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 411/833] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:54.197902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3ec6-f157-40fd-8fef-536f7cdd1fa0 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:54.205049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701ae1b-b2ac-41a7-bca5-a22ca685c82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-1701ae1b-b2ac-41a7-bca5-a22ca685c82b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:54.212322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:54.213605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:06:54.215209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:54.215954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 423/834] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:54.223474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701ae1b-b2ac-41a7-bca5-a22ca685c82b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:54.243457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:54.356896 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3ec6-f157-40fd-8fef-536f7cdd1fa0 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:54.384998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:54.391103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701ae1b-b2ac-41a7-bca5-a22ca685c82b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:54.405593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affbdc1-2855-4b55-b77c-dd1a36d8cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:54.406236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affbdc1-2855-4b55-b77c-dd1a36d8cf6a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:54.406568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affbdc1-2855-4b55-b77c-dd1a36d8cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:54.406908 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affbdc1-2855-4b55-b77c-dd1a36d8cf6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:54.408375 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affbdc1-2855-4b55-b77c-dd1a36d8cf6a None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=27f7331502484928ba7f8a4b403bdddd) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:54.408730 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affbdc1-2855-4b55-b77c-dd1a36d8cf6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:54.410210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affbdc1-2855-4b55-b77c-dd1a36d8cf6a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:54.419145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 412/835] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:54 2022] GET /identity/v3/role_assignments?user.id=27f7331502484928ba7f8a4b403bdddd&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:54.460316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd2bbd-3461-42b9-8a71-1ab82f8d5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:54.461329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd2bbd-3461-42b9-8a71-1ab82f8d5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:54.461764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd2bbd-3461-42b9-8a71-1ab82f8d5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:54.462192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd2bbd-3461-42b9-8a71-1ab82f8d5dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:54.463148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd2bbd-3461-42b9-8a71-1ab82f8d5dc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:54.463651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd2bbd-3461-42b9-8a71-1ab82f8d5dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:54.465475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd2bbd-3461-42b9-8a71-1ab82f8d5dc3 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:54.476423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 424/836] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:54.486520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affbdc1-2855-4b55-b77c-dd1a36d8cf6a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:54.604574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:54.614643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affbdc1-2855-4b55-b77c-dd1a36d8cf6a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:54.654129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b8f93-c4bf-4e2d-b480-a40590dee394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:54.654899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b8f93-c4bf-4e2d-b480-a40590dee394 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:54.655241 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b8f93-c4bf-4e2d-b480-a40590dee394 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:54.655584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b8f93-c4bf-4e2d-b480-a40590dee394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:54.666974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b8f93-c4bf-4e2d-b480-a40590dee394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:54.668684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b8f93-c4bf-4e2d-b480-a40590dee394 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-7f8b8f93-c4bf-4e2d-b480-a40590dee394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:54.685469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:54.686784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:54.687946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:54.687946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:54.687946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:54.687946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:54.688392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 413/837] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:54.694215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd2bbd-3461-42b9-8a71-1ab82f8d5dc3 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:54.806524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd2bbd-3461-42b9-8a71-1ab82f8d5dc3 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:54.844336 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53974478-123a-4473-878e-01fd0f88ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:54.845054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974478-123a-4473-878e-01fd0f88ea27 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:54.845400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974478-123a-4473-878e-01fd0f88ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:54.845742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974478-123a-4473-878e-01fd0f88ea27 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:54.846542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53974478-123a-4473-878e-01fd0f88ea27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:54.846909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53974478-123a-4473-878e-01fd0f88ea27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:54.848348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53974478-123a-4473-878e-01fd0f88ea27 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:54.863940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 425/838] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:54.869436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b8f93-c4bf-4e2d-b480-a40590dee394 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:54.981552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b8f93-c4bf-4e2d-b480-a40590dee394 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:55.017981 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6f66d-93ac-46d6-896f-9f97da437621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:55.018648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6f66d-93ac-46d6-896f-9f97da437621 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:55.018922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6f66d-93ac-46d6-896f-9f97da437621 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:55.019196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6f66d-93ac-46d6-896f-9f97da437621 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:55.027876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6f66d-93ac-46d6-896f-9f97da437621 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:55.029438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6f66d-93ac-46d6-896f-9f97da437621 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-7dd6f66d-93ac-46d6-896f-9f97da437621 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:55.041161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:55.042129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:55.043253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 414/839] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:06:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:55.048669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53974478-123a-4473-878e-01fd0f88ea27 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:55.075561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:55.160008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53974478-123a-4473-878e-01fd0f88ea27 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:55.196152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5681e37-805b-4180-b72d-2725b9397027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:55.196771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5681e37-805b-4180-b72d-2725b9397027 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:55.197047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5681e37-805b-4180-b72d-2725b9397027 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:55.197321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5681e37-805b-4180-b72d-2725b9397027 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:55.198331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5681e37-805b-4180-b72d-2725b9397027 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:55.198703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5681e37-805b-4180-b72d-2725b9397027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:55.200773 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5681e37-805b-4180-b72d-2725b9397027 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:55.219921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 426/840] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Aug 4 05:06:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:55.225826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6f66d-93ac-46d6-896f-9f97da437621 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:55.229964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:55.333070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6f66d-93ac-46d6-896f-9f97da437621 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:55.370504 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d3c1e-035f-4435-87b4-413809bd9529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:55.371739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3c1e-035f-4435-87b4-413809bd9529 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:55.372020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3c1e-035f-4435-87b4-413809bd9529 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:55.372298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3c1e-035f-4435-87b4-413809bd9529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:55.444775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d3c1e-035f-4435-87b4-413809bd9529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:55.446155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d3c1e-035f-4435-87b4-413809bd9529 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:55.449035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:55.559356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 415/841] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 05:06:55.565180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5681e37-805b-4180-b72d-2725b9397027 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:55.652971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:55.673385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5681e37-805b-4180-b72d-2725b9397027 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:55.714207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce55139-ffcd-4352-ae5e-1a9872e9250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:55.714851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55139-ffcd-4352-ae5e-1a9872e9250a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:55.715112 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55139-ffcd-4352-ae5e-1a9872e9250a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:55.715423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55139-ffcd-4352-ae5e-1a9872e9250a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:55.727360 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce55139-ffcd-4352-ae5e-1a9872e9250a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:55.728899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce55139-ffcd-4352-ae5e-1a9872e9250a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-bce55139-ffcd-4352-ae5e-1a9872e9250a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:55.749302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:55.752229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:55.754390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:55.754390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:55.754390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:55.754390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:55.754390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 427/842] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:55.763515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d3c1e-035f-4435-87b4-413809bd9529 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:55.835856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f967-bf52-4722-8c13-c21035579679 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:55.836475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f967-bf52-4722-8c13-c21035579679 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:55.836951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f967-bf52-4722-8c13-c21035579679 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:55.838922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 428/843] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:55.844770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cf638-9230-4879-835c-b3b9c9dfb041 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:55.845328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cf638-9230-4879-835c-b3b9c9dfb041 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:55.845822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cf638-9230-4879-835c-b3b9c9dfb041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:55.867489 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-6c5cf638-9230-4879-835c-b3b9c9dfb041 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:55.869100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6c5cf638-9230-4879-835c-b3b9c9dfb041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:55.870670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d3c1e-035f-4435-87b4-413809bd9529 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:55.874347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:55.923926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043d73e-b2af-4ded-9fff-f74bebdbd866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:55.925018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043d73e-b2af-4ded-9fff-f74bebdbd866 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:55.925968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043d73e-b2af-4ded-9fff-f74bebdbd866 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:55.926496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043d73e-b2af-4ded-9fff-f74bebdbd866 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:55.927821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043d73e-b2af-4ded-9fff-f74bebdbd866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:55.928638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043d73e-b2af-4ded-9fff-f74bebdbd866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:55.930511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043d73e-b2af-4ded-9fff-f74bebdbd866 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:55.951628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 416/844] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:55.954912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043d73e-b2af-4ded-9fff-f74bebdbd866 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:55.960861 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 429/845] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:06:55.985497 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cf638-9230-4879-835c-b3b9c9dfb041 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:56.054954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:56.078856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043d73e-b2af-4ded-9fff-f74bebdbd866 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:56.097085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cf638-9230-4879-835c-b3b9c9dfb041 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:56.115551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc5fe2-be59-4cae-95e7-21ac20533ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:56.116446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5fe2-be59-4cae-95e7-21ac20533ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.116947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5fe2-be59-4cae-95e7-21ac20533ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.117220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5fe2-be59-4cae-95e7-21ac20533ce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.124709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc5fe2-be59-4cae-95e7-21ac20533ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:56.126159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc5fe2-be59-4cae-95e7-21ac20533ce0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:56.133894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f901146-828d-46c6-af97-3206d16ab1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:56.134559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901146-828d-46c6-af97-3206d16ab1ea None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.134952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901146-828d-46c6-af97-3206d16ab1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.135229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901146-828d-46c6-af97-3206d16ab1ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.135916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f901146-828d-46c6-af97-3206d16ab1ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:56.137872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f901146-828d-46c6-af97-3206d16ab1ea None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-dedc5fe2-be59-4cae-95e7-21ac20533ce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:56.138993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:56.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:56.140781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:56.140781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:56.140781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:56.140781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:56.140781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:56.140781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:56.140781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:56.140781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:56.140781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 417/846] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:56.141705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9248a3-e828-4f7d-a17e-642db767df71 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.141705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9248a3-e828-4f7d-a17e-642db767df71 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.141872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9248a3-e828-4f7d-a17e-642db767df71 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.143255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 418/847] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:56.147816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9248a3-e828-4f7d-a17e-642db767df71 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-6f901146-828d-46c6-af97-3206d16ab1ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:56.153230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:56.154227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:56.155837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 430/848] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:06:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:56.157847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980ace4-5c34-4f79-9e43-8f4faf49394e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.157847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980ace4-5c34-4f79-9e43-8f4faf49394e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.157847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980ace4-5c34-4f79-9e43-8f4faf49394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.181565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:56.187033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9980ace4-5c34-4f79-9e43-8f4faf49394e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:56.188213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9980ace4-5c34-4f79-9e43-8f4faf49394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:56.263223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 431/849] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:06:56.263993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980ace4-5c34-4f79-9e43-8f4faf49394e None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:56.279093 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9248a3-e828-4f7d-a17e-642db767df71 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:56.319511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367c9da-d7bd-4016-925e-d610f10a892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:56.320129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367c9da-d7bd-4016-925e-d610f10a892b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.320417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367c9da-d7bd-4016-925e-d610f10a892b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.320681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367c9da-d7bd-4016-925e-d610f10a892b None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.321436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367c9da-d7bd-4016-925e-d610f10a892b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:56.321743 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367c9da-d7bd-4016-925e-d610f10a892b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:56.323192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367c9da-d7bd-4016-925e-d610f10a892b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:56.331406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:56.336154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 419/850] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:56.341954 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367c9da-d7bd-4016-925e-d610f10a892b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:56.383418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980ace4-5c34-4f79-9e43-8f4faf49394e None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:56.426736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401f1e1-5af2-468d-8a36-cbee4330a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:56.427379 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401f1e1-5af2-468d-8a36-cbee4330a0ca None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.427657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401f1e1-5af2-468d-8a36-cbee4330a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.427929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401f1e1-5af2-468d-8a36-cbee4330a0ca None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.428630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401f1e1-5af2-468d-8a36-cbee4330a0ca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:56.428932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401f1e1-5af2-468d-8a36-cbee4330a0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:56.430375 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401f1e1-5af2-468d-8a36-cbee4330a0ca None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:56.436568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 432/851] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:06:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:56.437440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401f1e1-5af2-468d-8a36-cbee4330a0ca None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:56.449631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:56.467716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367c9da-d7bd-4016-925e-d610f10a892b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:56.507419 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d7d41-9b6d-49e2-a5d1-7ce43f1470dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:56.508064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d7d41-9b6d-49e2-a5d1-7ce43f1470dd None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.508344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d7d41-9b6d-49e2-a5d1-7ce43f1470dd None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.508626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d7d41-9b6d-49e2-a5d1-7ce43f1470dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.519584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d7d41-9b6d-49e2-a5d1-7ce43f1470dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-3a5d7d41-9b6d-49e2-a5d1-7ce43f1470dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:06:56.524543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:56.525487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:56.526333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 420/852] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:06:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:56.527123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d7d41-9b6d-49e2-a5d1-7ce43f1470dd None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:56.559967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401f1e1-5af2-468d-8a36-cbee4330a0ca None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:56.582264 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:56.598243 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e308e-0cee-41b5-b9b1-fd30ef371d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:56.598886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e308e-0cee-41b5-b9b1-fd30ef371d66 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.599159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e308e-0cee-41b5-b9b1-fd30ef371d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.599426 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e308e-0cee-41b5-b9b1-fd30ef371d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.600208 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e308e-0cee-41b5-b9b1-fd30ef371d66 None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=67ac376400a7466a8e01582efcb91f40) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:56.600623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e308e-0cee-41b5-b9b1-fd30ef371d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:56.602163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e308e-0cee-41b5-b9b1-fd30ef371d66 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:56.622356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 433/853] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:56 2022] GET /identity/v3/role_assignments?user.id=67ac376400a7466a8e01582efcb91f40&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:56.622356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e308e-0cee-41b5-b9b1-fd30ef371d66 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:56.656520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d7d41-9b6d-49e2-a5d1-7ce43f1470dd None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:56.703088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ef9f1-da70-4cb6-8662-b4f6431e73df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:56.703748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef9f1-da70-4cb6-8662-b4f6431e73df None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.704059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef9f1-da70-4cb6-8662-b4f6431e73df None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.704340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef9f1-da70-4cb6-8662-b4f6431e73df None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.705078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ef9f1-da70-4cb6-8662-b4f6431e73df None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:56.705386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ef9f1-da70-4cb6-8662-b4f6431e73df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:56.706880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ef9f1-da70-4cb6-8662-b4f6431e73df None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:56.715369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 421/854] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:06:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:56.716964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1d535-3737-4dbd-8062-aa393f5a0e0c None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.717244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1d535-3737-4dbd-8062-aa393f5a0e0c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.717523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1d535-3737-4dbd-8062-aa393f5a0e0c None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.722555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 422/855] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:56.725314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ac3b6-b8f1-49c5-b707-1d911bf4a12a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.725607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ac3b6-b8f1-49c5-b707-1d911bf4a12a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.725888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ac3b6-b8f1-49c5-b707-1d911bf4a12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.747233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-dc1ac3b6-b8f1-49c5-b707-1d911bf4a12a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:56.748703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-dc1ac3b6-b8f1-49c5-b707-1d911bf4a12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:56.751870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:56.771006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e308e-0cee-41b5-b9b1-fd30ef371d66 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:56.820658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b41e8f-2b3d-4eaa-a09a-35ba4056b3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:56.821291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41e8f-2b3d-4eaa-a09a-35ba4056b3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:56.821610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41e8f-2b3d-4eaa-a09a-35ba4056b3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:56.821835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41e8f-2b3d-4eaa-a09a-35ba4056b3c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:56.822616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b41e8f-2b3d-4eaa-a09a-35ba4056b3c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:56.822917 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b41e8f-2b3d-4eaa-a09a-35ba4056b3c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:56.825040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b41e8f-2b3d-4eaa-a09a-35ba4056b3c3 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:56.836700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 423/856] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:06:56.842832 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 434/857] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:06:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:56.846217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ac3b6-b8f1-49c5-b707-1d911bf4a12a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:56.860933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b41e8f-2b3d-4eaa-a09a-35ba4056b3c3 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:56.928945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:56.982899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ac3b6-b8f1-49c5-b707-1d911bf4a12a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:56.999930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b41e8f-2b3d-4eaa-a09a-35ba4056b3c3 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:57.032176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec6971-75ed-495d-87ee-71f7bea17c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:57.033742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec6971-75ed-495d-87ee-71f7bea17c34 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:57.034300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec6971-75ed-495d-87ee-71f7bea17c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:57.034904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec6971-75ed-495d-87ee-71f7bea17c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:57.038959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305af41b-a6ec-4f0a-b2c2-e46ba927f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:57.039682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305af41b-a6ec-4f0a-b2c2-e46ba927f346 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:57.040034 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305af41b-a6ec-4f0a-b2c2-e46ba927f346 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:57.040380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305af41b-a6ec-4f0a-b2c2-e46ba927f346 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:57.041086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305af41b-a6ec-4f0a-b2c2-e46ba927f346 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:57.042572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305af41b-a6ec-4f0a-b2c2-e46ba927f346 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:57.044620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:57.050277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec6971-75ed-495d-87ee-71f7bea17c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:57.052149 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec6971-75ed-495d-87ee-71f7bea17c34 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-305af41b-a6ec-4f0a-b2c2-e46ba927f346 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:57.054899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:57.060253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 05:06:57.061111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:57.061900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 435/858] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Aug 4 05:06:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:57.062921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305af41b-a6ec-4f0a-b2c2-e46ba927f346 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-efec6971-75ed-495d-87ee-71f7bea17c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:57.075771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:57.076913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:57.078035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:57.078035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:57.078035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:57.078035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:57.085566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 424/859] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:06:57.087553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec6971-75ed-495d-87ee-71f7bea17c34 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:57.203165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305af41b-a6ec-4f0a-b2c2-e46ba927f346 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:57.219933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:57.223897 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec6971-75ed-495d-87ee-71f7bea17c34 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:57.255554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56791e9-2d2a-4914-993b-f068ff7c302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:57.256747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56791e9-2d2a-4914-993b-f068ff7c302c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:57.257533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56791e9-2d2a-4914-993b-f068ff7c302c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:57.258136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56791e9-2d2a-4914-993b-f068ff7c302c None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:57.259282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56791e9-2d2a-4914-993b-f068ff7c302c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:57.259885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56791e9-2d2a-4914-993b-f068ff7c302c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:57.262468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56791e9-2d2a-4914-993b-f068ff7c302c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:57.263436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95bf1e-c62a-4cdd-bb7e-4274f649079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:57.264431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95bf1e-c62a-4cdd-bb7e-4274f649079d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:57.264930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95bf1e-c62a-4cdd-bb7e-4274f649079d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:57.265425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95bf1e-c62a-4cdd-bb7e-4274f649079d None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:57.266205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95bf1e-c62a-4cdd-bb7e-4274f649079d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:57.266764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95bf1e-c62a-4cdd-bb7e-4274f649079d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:57.268067 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95bf1e-c62a-4cdd-bb7e-4274f649079d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:57.271394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 436/860] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:06:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:57.277119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56791e9-2d2a-4914-993b-f068ff7c302c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:57.290218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 425/861] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:57.291718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95bf1e-c62a-4cdd-bb7e-4274f649079d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:57.362717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:57.406445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95bf1e-c62a-4cdd-bb7e-4274f649079d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:57.408951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56791e9-2d2a-4914-993b-f068ff7c302c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:57.447010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feb9ea-8ab7-4119-b43a-b52b37f47b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:57.447854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feb9ea-8ab7-4119-b43a-b52b37f47b58 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:57.448266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feb9ea-8ab7-4119-b43a-b52b37f47b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:57.448726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feb9ea-8ab7-4119-b43a-b52b37f47b58 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:57.449962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feb9ea-8ab7-4119-b43a-b52b37f47b58 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:57.450415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feb9ea-8ab7-4119-b43a-b52b37f47b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:57.452081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feb9ea-8ab7-4119-b43a-b52b37f47b58 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:57.455920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de672-413c-4ecf-9ff3-a9d7ec142746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:57.456778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de672-413c-4ecf-9ff3-a9d7ec142746 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:57.457209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de672-413c-4ecf-9ff3-a9d7ec142746 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:57.457635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de672-413c-4ecf-9ff3-a9d7ec142746 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:57.463883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 437/862] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:06:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:06:57.467995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4de672-413c-4ecf-9ff3-a9d7ec142746 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:57.469741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4de672-413c-4ecf-9ff3-a9d7ec142746 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-9a4de672-413c-4ecf-9ff3-a9d7ec142746 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:06:57.483606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:57.484851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:57.486097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:57.486097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:57.486097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:06:57.486097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:06:57.486097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:06:57.486097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:06:57.486097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:06:57.486097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:06:57.486097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:06:57.486097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:06:57.488562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 426/863] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 4 05:06:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:57.495507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feb9ea-8ab7-4119-b43a-b52b37f47b58 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:57.544944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:57.617727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feb9ea-8ab7-4119-b43a-b52b37f47b58 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:57.660849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea0ff6-8679-4698-a553-88e3fc9c9efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:57.660849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea0ff6-8679-4698-a553-88e3fc9c9efe None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:57.660849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea0ff6-8679-4698-a553-88e3fc9c9efe None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:57.660849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea0ff6-8679-4698-a553-88e3fc9c9efe None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:57.661273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea0ff6-8679-4698-a553-88e3fc9c9efe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:57.661273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea0ff6-8679-4698-a553-88e3fc9c9efe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:57.662693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea0ff6-8679-4698-a553-88e3fc9c9efe None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:57.682827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 438/864] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Aug 4 05:06:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:57.689180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de672-413c-4ecf-9ff3-a9d7ec142746 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:57.805348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de672-413c-4ecf-9ff3-a9d7ec142746 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:57.823596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:57.843126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad783cac-074d-4509-80f4-855d590c2399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:57.843763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad783cac-074d-4509-80f4-855d590c2399 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:57.844044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad783cac-074d-4509-80f4-855d590c2399 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:57.844322 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad783cac-074d-4509-80f4-855d590c2399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:57.931196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad783cac-074d-4509-80f4-855d590c2399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:57.932714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad783cac-074d-4509-80f4-855d590c2399 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:58.040927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 427/865] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:06:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:06:58.047685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea0ff6-8679-4698-a553-88e3fc9c9efe None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:58.155628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:58.159979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea0ff6-8679-4698-a553-88e3fc9c9efe None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:58.197421 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d46a4-991a-41f1-b107-2522b0e3b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:58.198057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d46a4-991a-41f1-b107-2522b0e3b49c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:58.198348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d46a4-991a-41f1-b107-2522b0e3b49c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:58.198624 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d46a4-991a-41f1-b107-2522b0e3b49c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:58.210823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d46a4-991a-41f1-b107-2522b0e3b49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:58.212602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d46a4-991a-41f1-b107-2522b0e3b49c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-1e7d46a4-991a-41f1-b107-2522b0e3b49c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:06:58.232277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:58.233320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:58.234354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:06:58.234354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:06:58.234354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:06:58.234354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:58.236718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 439/866] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:58.246408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad783cac-074d-4509-80f4-855d590c2399 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:58.258805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:58.351312 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad783cac-074d-4509-80f4-855d590c2399 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:58.397347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009ba4f-2054-456e-bd72-f1fdfe04cff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:58.397995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009ba4f-2054-456e-bd72-f1fdfe04cff6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:58.398276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009ba4f-2054-456e-bd72-f1fdfe04cff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:58.398603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009ba4f-2054-456e-bd72-f1fdfe04cff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:58.399325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009ba4f-2054-456e-bd72-f1fdfe04cff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:58.399629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009ba4f-2054-456e-bd72-f1fdfe04cff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:58.401044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009ba4f-2054-456e-bd72-f1fdfe04cff6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:58.415755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 428/867] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:58.422425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d46a4-991a-41f1-b107-2522b0e3b49c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:58.545928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d46a4-991a-41f1-b107-2522b0e3b49c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:58.584775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192afe95-51d7-4201-94fe-e52c46f485ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:58.585856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192afe95-51d7-4201-94fe-e52c46f485ad None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:58.586384 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192afe95-51d7-4201-94fe-e52c46f485ad None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:58.586887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192afe95-51d7-4201-94fe-e52c46f485ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:58.596121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192afe95-51d7-4201-94fe-e52c46f485ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:58.597978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192afe95-51d7-4201-94fe-e52c46f485ad None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-192afe95-51d7-4201-94fe-e52c46f485ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:06:58.612551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:58.613552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:58.614469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:06:58.614469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:06:58.614469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:06:58.614469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:06:58.614469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:06:58.614469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:06:58.614469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:06:58.614469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:58.617135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 440/868] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:06:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:58.623091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009ba4f-2054-456e-bd72-f1fdfe04cff6 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:58.704117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:58.746140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009ba4f-2054-456e-bd72-f1fdfe04cff6 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:58.786724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c7bab-aa9f-4ffa-944e-ba8379f9f886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:58.787632 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c7bab-aa9f-4ffa-944e-ba8379f9f886 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:58.788143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c7bab-aa9f-4ffa-944e-ba8379f9f886 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:58.788588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c7bab-aa9f-4ffa-944e-ba8379f9f886 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:58.789508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c7bab-aa9f-4ffa-944e-ba8379f9f886 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:58.789976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c7bab-aa9f-4ffa-944e-ba8379f9f886 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:58.791663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c7bab-aa9f-4ffa-944e-ba8379f9f886 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:58.806078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 429/869] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:06:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:58.815463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192afe95-51d7-4201-94fe-e52c46f485ad None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:58.832976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:58.874890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966ab7e-7b70-40bd-8df6-fe1e26f759c0 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:58.875171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966ab7e-7b70-40bd-8df6-fe1e26f759c0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:58.875444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966ab7e-7b70-40bd-8df6-fe1e26f759c0 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:58.877186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 430/870] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:06:58.883703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f253e-5d83-4ed1-a258-18530344cf50 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:58.883984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f253e-5d83-4ed1-a258-18530344cf50 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:58.884255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f253e-5d83-4ed1-a258-18530344cf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:58.905729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-f87f253e-5d83-4ed1-a258-18530344cf50 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:58.906942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f87f253e-5d83-4ed1-a258-18530344cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:58.945370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192afe95-51d7-4201-94fe-e52c46f485ad None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:58.976239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 431/871] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:06:58.977492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ff107-96bf-426c-8776-117f0d4e38c2 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:58.977816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ff107-96bf-426c-8776-117f0d4e38c2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:58.978086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ff107-96bf-426c-8776-117f0d4e38c2 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:58.982431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 432/872] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:58.985325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a123a68-3ffd-4a69-b30d-c305882deb88 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:58.985756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a123a68-3ffd-4a69-b30d-c305882deb88 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:58.986035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a123a68-3ffd-4a69-b30d-c305882deb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:58.995886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f014-64b5-4194-bef2-bf1ef8647df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:58.997061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f014-64b5-4194-bef2-bf1ef8647df4 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:58.997575 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f014-64b5-4194-bef2-bf1ef8647df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:58.998066 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f014-64b5-4194-bef2-bf1ef8647df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:58.999144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f014-64b5-4194-bef2-bf1ef8647df4 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=c6bef167110b40519ff4e31456803b09) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:58.999700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f014-64b5-4194-bef2-bf1ef8647df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:59.002093 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f014-64b5-4194-bef2-bf1ef8647df4 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:59.005464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-7a123a68-3ffd-4a69-b30d-c305882deb88 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:59.006660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7a123a68-3ffd-4a69-b30d-c305882deb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:59.014524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 441/873] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:06:58 2022] GET /identity/v3/role_assignments?user.id=c6bef167110b40519ff4e31456803b09&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:59.016282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f014-64b5-4194-bef2-bf1ef8647df4 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:59.075585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:59.094724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 433/874] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:06:59.111713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a123a68-3ffd-4a69-b30d-c305882deb88 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:59.150707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:59.168980 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f014-64b5-4194-bef2-bf1ef8647df4 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:59.220022 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2b911-5c64-4537-8e80-f32485d0e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:59.220654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2b911-5c64-4537-8e80-f32485d0e2bc None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:59.220930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2b911-5c64-4537-8e80-f32485d0e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:59.221199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2b911-5c64-4537-8e80-f32485d0e2bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:59.221853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2b911-5c64-4537-8e80-f32485d0e2bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:59.224052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2b911-5c64-4537-8e80-f32485d0e2bc None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-41a2b911-5c64-4537-8e80-f32485d0e2bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:06:59.234383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:06:59.235453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:06:59.236320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 442/875] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:06:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:06:59.241906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2b911-5c64-4537-8e80-f32485d0e2bc None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:59.249194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a123a68-3ffd-4a69-b30d-c305882deb88 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:59.303674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c44a8-cf04-4763-b577-f530dc625e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:59.304314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c44a8-cf04-4763-b577-f530dc625e15 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:59.304631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c44a8-cf04-4763-b577-f530dc625e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:59.304907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c44a8-cf04-4763-b577-f530dc625e15 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:59.305623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c44a8-cf04-4763-b577-f530dc625e15 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:59.307032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c44a8-cf04-4763-b577-f530dc625e15 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:59.365927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2b911-5c64-4537-8e80-f32485d0e2bc None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:59.382988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 434/876] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:06:59 2022] POST /identity/v3/services => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:06:59.413280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:59.421567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab412-8538-4f7e-94d7-0079c4d54045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:59.422858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab412-8538-4f7e-94d7-0079c4d54045 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:59.423320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab412-8538-4f7e-94d7-0079c4d54045 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:59.423749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab412-8538-4f7e-94d7-0079c4d54045 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:59.424753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cab412-8538-4f7e-94d7-0079c4d54045 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:59.425226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cab412-8538-4f7e-94d7-0079c4d54045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:59.426859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cab412-8538-4f7e-94d7-0079c4d54045 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:59.436727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 443/877] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Aug 4 05:06:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:59.443742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c44a8-cf04-4763-b577-f530dc625e15 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:06:59.507452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:06:59.564704 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c44a8-cf04-4763-b577-f530dc625e15 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:06:59.602167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f4dad-6dfb-4a28-bf88-c45f9adb11c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:06:59.602818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4dad-6dfb-4a28-bf88-c45f9adb11c6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:59.603103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4dad-6dfb-4a28-bf88-c45f9adb11c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:59.603389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4dad-6dfb-4a28-bf88-c45f9adb11c6 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:59.604037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f4dad-6dfb-4a28-bf88-c45f9adb11c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:06:59.604397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f4dad-6dfb-4a28-bf88-c45f9adb11c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:06:59.606870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f4dad-6dfb-4a28-bf88-c45f9adb11c6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:06:59.612659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 435/878] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Aug 4 05:06:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:06:59.744737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c59a6b-a55f-4f74-87d7-0f4fa0d28a69 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:59.745099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c59a6b-a55f-4f74-87d7-0f4fa0d28a69 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:59.745282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c59a6b-a55f-4f74-87d7-0f4fa0d28a69 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:59.747530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 444/879] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:06:59.753405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aae3d-bc03-48ac-a218-49746b29cc30 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:06:59.753819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aae3d-bc03-48ac-a218-49746b29cc30 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:06:59.754194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aae3d-bc03-48ac-a218-49746b29cc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:06:59.775174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-df5aae3d-bc03-48ac-a218-49746b29cc30 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:06:59.776283 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-df5aae3d-bc03-48ac-a218-49746b29cc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:06:59.856692 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 436/880] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:06:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:06:59.879757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c59a6b-a55f-4f74-87d7-0f4fa0d28a69 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:00.001573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c59a6b-a55f-4f74-87d7-0f4fa0d28a69 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:00.037816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec3c1f-0364-4f2d-82f6-e94098587c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:00.038398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec3c1f-0364-4f2d-82f6-e94098587c3a None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:00.038650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec3c1f-0364-4f2d-82f6-e94098587c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:00.038917 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec3c1f-0364-4f2d-82f6-e94098587c3a None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:00.039613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec3c1f-0364-4f2d-82f6-e94098587c3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:00.040951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec3c1f-0364-4f2d-82f6-e94098587c3a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:00.130726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 445/881] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:06:59 2022] POST /identity/v3/services => generated 269 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:01.261338 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96476a2-a650-4e1f-8f0d-43122fee266b None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:01.263064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96476a2-a650-4e1f-8f0d-43122fee266b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:01.263568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96476a2-a650-4e1f-8f0d-43122fee266b None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:01.265458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 437/882] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:01.271589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04c54-298d-48e8-9c26-cff4bd6b519b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:01.272496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04c54-298d-48e8-9c26-cff4bd6b519b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:01.272981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04c54-298d-48e8-9c26-cff4bd6b519b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:01.294797 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-dcd04c54-298d-48e8-9c26-cff4bd6b519b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:01.296423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-dcd04c54-298d-48e8-9c26-cff4bd6b519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:01.354267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:01.379516 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 446/883] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:01.405864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96476a2-a650-4e1f-8f0d-43122fee266b None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:01.458895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:01.516280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96476a2-a650-4e1f-8f0d-43122fee266b None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:01.537696 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690103d-f7cd-4cfa-ac33-7a5e15f06277 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:01.538352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690103d-f7cd-4cfa-ac33-7a5e15f06277 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:01.538866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690103d-f7cd-4cfa-ac33-7a5e15f06277 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:01.541027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 447/884] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:07:01.546353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbc778-84a7-4ae8-9f50-466c9ce26367 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:01.547179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbc778-84a7-4ae8-9f50-466c9ce26367 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:01.547755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbc778-84a7-4ae8-9f50-466c9ce26367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:01.551508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433665fe-347a-4ed2-a447-5ba37e4dd434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:01.552224 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433665fe-347a-4ed2-a447-5ba37e4dd434 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:01.552509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433665fe-347a-4ed2-a447-5ba37e4dd434 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:01.552783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433665fe-347a-4ed2-a447-5ba37e4dd434 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:01.567627 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433665fe-347a-4ed2-a447-5ba37e4dd434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:01.570126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-35cbc778-84a7-4ae8-9f50-466c9ce26367 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:01.571627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-35cbc778-84a7-4ae8-9f50-466c9ce26367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-433665fe-347a-4ed2-a447-5ba37e4dd434 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:01.577300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:01.578293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:01.579178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 438/885] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Aug 4 05:07:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:01.587219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433665fe-347a-4ed2-a447-5ba37e4dd434 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:01.664526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 448/886] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:01.664526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6b32e-2248-478a-8e48-5ebc6f42ea2d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:01.664526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6b32e-2248-478a-8e48-5ebc6f42ea2d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:01.664526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6b32e-2248-478a-8e48-5ebc6f42ea2d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:01.664526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 449/887] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:01.670704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3af3f-1bd3-47d7-b9d9-e82aec7b00f3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:01.670943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3af3f-1bd3-47d7-b9d9-e82aec7b00f3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:01.671214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3af3f-1bd3-47d7-b9d9-e82aec7b00f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:01.690448 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-dea3af3f-1bd3-47d7-b9d9-e82aec7b00f3 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:01.691612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-dea3af3f-1bd3-47d7-b9d9-e82aec7b00f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:01.713587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433665fe-347a-4ed2-a447-5ba37e4dd434 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:01.717434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:01.753751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f925d-d010-4829-a8a3-0c61d8dad7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:01.754674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f925d-d010-4829-a8a3-0c61d8dad7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:01.754950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f925d-d010-4829-a8a3-0c61d8dad7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:01.755252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f925d-d010-4829-a8a3-0c61d8dad7b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:01.756370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f925d-d010-4829-a8a3-0c61d8dad7b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:01.756676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f925d-d010-4829-a8a3-0c61d8dad7b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:01.758804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f925d-d010-4829-a8a3-0c61d8dad7b7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:01.768400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 439/888] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Aug 4 05:07:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:01.769310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 450/889] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:01.770579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f925d-d010-4829-a8a3-0c61d8dad7b7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:01.773924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3af3f-1bd3-47d7-b9d9-e82aec7b00f3 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:01.825380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:01.892195 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f925d-d010-4829-a8a3-0c61d8dad7b7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:01.893159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3af3f-1bd3-47d7-b9d9-e82aec7b00f3 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:01.928172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7767-1320-480e-bd6a-ffd17f95f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:01.928805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7767-1320-480e-bd6a-ffd17f95f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:01.929080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7767-1320-480e-bd6a-ffd17f95f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:01.929347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7767-1320-480e-bd6a-ffd17f95f9d7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:01.929964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c7767-1320-480e-bd6a-ffd17f95f9d7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:01.931037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d0844-6c78-4e20-bdbd-63e9c07dc1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:01.931344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c7767-1320-480e-bd6a-ffd17f95f9d7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:01.932242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d0844-6c78-4e20-bdbd-63e9c07dc1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:01.932697 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d0844-6c78-4e20-bdbd-63e9c07dc1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:01.933283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d0844-6c78-4e20-bdbd-63e9c07dc1b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-849c7767-1320-480e-bd6a-ffd17f95f9d7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:01.940795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:01.941817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:01.942708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 440/890] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:07:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:01.943501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7767-1320-480e-bd6a-ffd17f95f9d7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:01.950095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d0844-6c78-4e20-bdbd-63e9c07dc1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:01.952128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d0844-6c78-4e20-bdbd-63e9c07dc1b1 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-7a3d0844-6c78-4e20-bdbd-63e9c07dc1b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:01.968928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:01.969879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:01.975692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:01.975692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:01.975692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:01.975692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:01.975692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 451/891] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:01.975692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d0844-6c78-4e20-bdbd-63e9c07dc1b1 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:01.987604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:02.059399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7767-1320-480e-bd6a-ffd17f95f9d7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:02.072633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:02.079887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d0844-6c78-4e20-bdbd-63e9c07dc1b1 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:02.098296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa4dc1-2458-412a-af15-6033340e58b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:02.099160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa4dc1-2458-412a-af15-6033340e58b5 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.099583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa4dc1-2458-412a-af15-6033340e58b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.100037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa4dc1-2458-412a-af15-6033340e58b5 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.100733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa4dc1-2458-412a-af15-6033340e58b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:02.102099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa4dc1-2458-412a-af15-6033340e58b5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:02.115139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bc0ee-841d-450c-a251-15bebdc2e8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:02.115783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bc0ee-841d-450c-a251-15bebdc2e8bc None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.116056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bc0ee-841d-450c-a251-15bebdc2e8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.120296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bc0ee-841d-450c-a251-15bebdc2e8bc None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.120296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bc0ee-841d-450c-a251-15bebdc2e8bc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:02.120296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bc0ee-841d-450c-a251-15bebdc2e8bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:02.120296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bc0ee-841d-450c-a251-15bebdc2e8bc None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:02.124017 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 452/892] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:07:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:02.124609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bc0ee-841d-450c-a251-15bebdc2e8bc None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:02.208794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 441/893] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:07:01 2022] POST /identity/v3/services => generated 241 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:02.209933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa4dc1-2458-412a-af15-6033340e58b5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:02.241096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bc0ee-841d-450c-a251-15bebdc2e8bc None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:02.289369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592be85-5370-42da-ab37-c1e7cf8c4930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:02.290771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592be85-5370-42da-ab37-c1e7cf8c4930 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.291203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592be85-5370-42da-ab37-c1e7cf8c4930 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.291673 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592be85-5370-42da-ab37-c1e7cf8c4930 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.292572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592be85-5370-42da-ab37-c1e7cf8c4930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:02.293183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592be85-5370-42da-ab37-c1e7cf8c4930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:02.294622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592be85-5370-42da-ab37-c1e7cf8c4930 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:02.308759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 453/894] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:02.310208 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13dbd-5072-480a-94f1-9ee9f263c58d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.310509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13dbd-5072-480a-94f1-9ee9f263c58d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.310789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13dbd-5072-480a-94f1-9ee9f263c58d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.314357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 454/895] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:02.314629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13dbd-5072-480a-94f1-9ee9f263c58d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:02.334624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:02.337860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:02.344985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa4dc1-2458-412a-af15-6033340e58b5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:02.384085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0510f-b8cf-4b31-9c92-90576e3031cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:02.384707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0510f-b8cf-4b31-9c92-90576e3031cd None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.385550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0510f-b8cf-4b31-9c92-90576e3031cd None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.385550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0510f-b8cf-4b31-9c92-90576e3031cd None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.385921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0510f-b8cf-4b31-9c92-90576e3031cd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:02.386221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0510f-b8cf-4b31-9c92-90576e3031cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:02.388297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0510f-b8cf-4b31-9c92-90576e3031cd None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:02.393590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 442/896] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:07:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:02.395080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196c7a4-8d98-4d19-8465-6274e7fc5b74 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.395636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196c7a4-8d98-4d19-8465-6274e7fc5b74 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.396128 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196c7a4-8d98-4d19-8465-6274e7fc5b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.416722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-0196c7a4-8d98-4d19-8465-6274e7fc5b74 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:02.419173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0196c7a4-8d98-4d19-8465-6274e7fc5b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:02.439097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13dbd-5072-480a-94f1-9ee9f263c58d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:02.477959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0144f6-f8b8-4318-a6e3-39e025234f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:02.478618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0144f6-f8b8-4318-a6e3-39e025234f46 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.478890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0144f6-f8b8-4318-a6e3-39e025234f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.479156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0144f6-f8b8-4318-a6e3-39e025234f46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.487912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0144f6-f8b8-4318-a6e3-39e025234f46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:02.489331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0144f6-f8b8-4318-a6e3-39e025234f46 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:02.498586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 443/897] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:02.498586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196c7a4-8d98-4d19-8465-6274e7fc5b74 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-5e0144f6-f8b8-4318-a6e3-39e025234f46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:07:02.504573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:02.506161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:02.507737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 455/898] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 4 05:07:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:02.514836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0144f6-f8b8-4318-a6e3-39e025234f46 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:02.596256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:02.607649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:02.623113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0144f6-f8b8-4318-a6e3-39e025234f46 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:02.623656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196c7a4-8d98-4d19-8465-6274e7fc5b74 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:02.658534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f459f-dc6b-4f72-bb85-05498c6b8983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:02.659150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f459f-dc6b-4f72-bb85-05498c6b8983 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.659417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f459f-dc6b-4f72-bb85-05498c6b8983 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.659685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f459f-dc6b-4f72-bb85-05498c6b8983 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.660276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35044767-aecb-4276-83a4-220bcc8833a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:02.660459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f459f-dc6b-4f72-bb85-05498c6b8983 None admin] RBAC: Adding query filter params (interface=public, service_id=25f98c3f277e4dd69a5068ff6b565582, region_id=RegionOne) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:02.660735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f459f-dc6b-4f72-bb85-05498c6b8983 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:02.660902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35044767-aecb-4276-83a4-220bcc8833a8 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.661159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35044767-aecb-4276-83a4-220bcc8833a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.661432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35044767-aecb-4276-83a4-220bcc8833a8 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.662083 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f459f-dc6b-4f72-bb85-05498c6b8983 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:02.662267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35044767-aecb-4276-83a4-220bcc8833a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:02.662582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35044767-aecb-4276-83a4-220bcc8833a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:02.663997 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35044767-aecb-4276-83a4-220bcc8833a8 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:02.672435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 444/899] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 4 05:07:02 2022] GET /identity/v3/endpoints?service_id=25f98c3f277e4dd69a5068ff6b565582&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:02.673323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f459f-dc6b-4f72-bb85-05498c6b8983 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:02.685930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 456/900] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Aug 4 05:07:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:02.686900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35044767-aecb-4276-83a4-220bcc8833a8 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:02.784257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f459f-dc6b-4f72-bb85-05498c6b8983 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:02.803182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35044767-aecb-4276-83a4-220bcc8833a8 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:02.819564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa2c0e-6f5b-4086-81ed-da657dad9053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:02.820204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa2c0e-6f5b-4086-81ed-da657dad9053 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.820485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa2c0e-6f5b-4086-81ed-da657dad9053 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.820760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa2c0e-6f5b-4086-81ed-da657dad9053 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.821390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa2c0e-6f5b-4086-81ed-da657dad9053 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:02.822786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa2c0e-6f5b-4086-81ed-da657dad9053 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-b0aa2c0e-6f5b-4086-81ed-da657dad9053 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:02.832379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:02.833318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:02.834151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 445/901] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Aug 4 05:07:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:02.835066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa2c0e-6f5b-4086-81ed-da657dad9053 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:02.840507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:02.845912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1f275-e6a5-4004-a7b3-853c15316887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:02.846840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f275-e6a5-4004-a7b3-853c15316887 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:02.853286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f275-e6a5-4004-a7b3-853c15316887 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:02.853286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f275-e6a5-4004-a7b3-853c15316887 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:02.853286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1f275-e6a5-4004-a7b3-853c15316887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:02.853286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1f275-e6a5-4004-a7b3-853c15316887 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:02.855020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:02.857863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 457/902] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 4 05:07:02 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:07:02.858896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1f275-e6a5-4004-a7b3-853c15316887 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:02.962148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa2c0e-6f5b-4086-81ed-da657dad9053 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:02.980053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1f275-e6a5-4004-a7b3-853c15316887 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:03.003245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96fa66-9420-4111-81aa-3fb894894916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:03.004143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96fa66-9420-4111-81aa-3fb894894916 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:03.004593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96fa66-9420-4111-81aa-3fb894894916 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:03.005023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96fa66-9420-4111-81aa-3fb894894916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:03.019094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054163-51be-4aba-aff8-628f0df2ea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:03.019725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054163-51be-4aba-aff8-628f0df2ea5b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:03.020001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054163-51be-4aba-aff8-628f0df2ea5b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:03.021008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054163-51be-4aba-aff8-628f0df2ea5b None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:03.021789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa054163-51be-4aba-aff8-628f0df2ea5b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:03.022098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa054163-51be-4aba-aff8-628f0df2ea5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:03.023494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa054163-51be-4aba-aff8-628f0df2ea5b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:03.029121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 458/903] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:07:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:03.036763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054163-51be-4aba-aff8-628f0df2ea5b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:03.098952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96fa66-9420-4111-81aa-3fb894894916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:03.100400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96fa66-9420-4111-81aa-3fb894894916 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:03.104422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:03.118154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:03.161368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054163-51be-4aba-aff8-628f0df2ea5b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:03.210095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06946df9-159c-4ea9-9a0f-484a4b74e406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:03.211772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06946df9-159c-4ea9-9a0f-484a4b74e406 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:03.212253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06946df9-159c-4ea9-9a0f-484a4b74e406 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:03.213052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06946df9-159c-4ea9-9a0f-484a4b74e406 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:03.214521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06946df9-159c-4ea9-9a0f-484a4b74e406 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:03.215176 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06946df9-159c-4ea9-9a0f-484a4b74e406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:03.216753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06946df9-159c-4ea9-9a0f-484a4b74e406 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:03.218343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 446/904] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:02 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:07:03.223879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96fa66-9420-4111-81aa-3fb894894916 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:03.228174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 459/905] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:07:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:03.235283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06946df9-159c-4ea9-9a0f-484a4b74e406 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:03.343903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96fa66-9420-4111-81aa-3fb894894916 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:03.358896 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:03.365996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06946df9-159c-4ea9-9a0f-484a4b74e406 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:03.390890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cddb2e-9d43-420f-b815-238a2cbec1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:03.391549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cddb2e-9d43-420f-b815-238a2cbec1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:03.391825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cddb2e-9d43-420f-b815-238a2cbec1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:03.392096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cddb2e-9d43-420f-b815-238a2cbec1f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:03.402454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:03.405322 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cddb2e-9d43-420f-b815-238a2cbec1f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:03.407125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cddb2e-9d43-420f-b815-238a2cbec1f1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:03.415844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35b0c5-2083-4185-bbc4-9efe926ae31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:03.416750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35b0c5-2083-4185-bbc4-9efe926ae31c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:03.417250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35b0c5-2083-4185-bbc4-9efe926ae31c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:03.418263 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35b0c5-2083-4185-bbc4-9efe926ae31c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:03.419313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35b0c5-2083-4185-bbc4-9efe926ae31c None admin] RBAC: Adding query filter params (interface=public, service_id=334811fcef524c17924959f5b0d0c9ad, region_id=RegionOne) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:03.419857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35b0c5-2083-4185-bbc4-9efe926ae31c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:03.421450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35b0c5-2083-4185-bbc4-9efe926ae31c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-c0cddb2e-9d43-420f-b815-238a2cbec1f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:03.422666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:03.423531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:03.424411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:03.424411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:03.424411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:03.424411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:03.428635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 447/906] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:03.430099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cddb2e-9d43-420f-b815-238a2cbec1f1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:03.431844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 460/907] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 4 05:07:03 2022] GET /identity/v3/endpoints?service_id=334811fcef524c17924959f5b0d0c9ad&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:03.439213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35b0c5-2083-4185-bbc4-9efe926ae31c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:03.537840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cddb2e-9d43-420f-b815-238a2cbec1f1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:03.553769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35b0c5-2083-4185-bbc4-9efe926ae31c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:03.572739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7341-0cd4-4caa-95dc-d1c0869d46de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:03.573349 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7341-0cd4-4caa-95dc-d1c0869d46de None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:03.573630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7341-0cd4-4caa-95dc-d1c0869d46de None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:03.574737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7341-0cd4-4caa-95dc-d1c0869d46de None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:03.575602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7341-0cd4-4caa-95dc-d1c0869d46de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:03.575713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7341-0cd4-4caa-95dc-d1c0869d46de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:03.577078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7341-0cd4-4caa-95dc-d1c0869d46de None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:03.594348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 448/908] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:03.595308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88100c88-acae-4af7-930d-ef8c25dc36a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:03.595534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7341-0cd4-4caa-95dc-d1c0869d46de None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:03.596452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88100c88-acae-4af7-930d-ef8c25dc36a6 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:03.596975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88100c88-acae-4af7-930d-ef8c25dc36a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:03.597452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88100c88-acae-4af7-930d-ef8c25dc36a6 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:03.598455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88100c88-acae-4af7-930d-ef8c25dc36a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:03.600206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88100c88-acae-4af7-930d-ef8c25dc36a6 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:03.612892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 461/909] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 4 05:07:03 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:07:03.622630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:03.716759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7341-0cd4-4caa-95dc-d1c0869d46de None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:03.754868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d085b-3b95-42c5-912f-dfd2a4673119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:03.755524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d085b-3b95-42c5-912f-dfd2a4673119 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:03.755801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d085b-3b95-42c5-912f-dfd2a4673119 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:03.756072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d085b-3b95-42c5-912f-dfd2a4673119 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:03.764435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d085b-3b95-42c5-912f-dfd2a4673119 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:03.765911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d085b-3b95-42c5-912f-dfd2a4673119 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-428d085b-3b95-42c5-912f-dfd2a4673119 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:07:03.778239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:03.779228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:03.780114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:07:03.780114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:07:03.780114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:07:03.780114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:07:03.780114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:07:03.780114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:07:03.780114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:03.780114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:03.784267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 449/910] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:07:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:03.785603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88100c88-acae-4af7-930d-ef8c25dc36a6 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:03.846444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:03.897006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88100c88-acae-4af7-930d-ef8c25dc36a6 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:03.934770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdb380-9345-4a40-8779-b87ba134f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:03.935712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdb380-9345-4a40-8779-b87ba134f8dc None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:03.936174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdb380-9345-4a40-8779-b87ba134f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:03.936617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdb380-9345-4a40-8779-b87ba134f8dc None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:03.937547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdb380-9345-4a40-8779-b87ba134f8dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:03.938023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdb380-9345-4a40-8779-b87ba134f8dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:03.939636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdb380-9345-4a40-8779-b87ba134f8dc None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:03.957489 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 462/911] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:07:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:03.959334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d085b-3b95-42c5-912f-dfd2a4673119 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:04.054086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:04.071164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d085b-3b95-42c5-912f-dfd2a4673119 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:04.108098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38266ab6-9aa6-4908-bcab-91b326743f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:04.108688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38266ab6-9aa6-4908-bcab-91b326743f5c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:04.108996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38266ab6-9aa6-4908-bcab-91b326743f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:04.109267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38266ab6-9aa6-4908-bcab-91b326743f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:04.110172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38266ab6-9aa6-4908-bcab-91b326743f5c None admin] RBAC: Adding query filter params (role.id=343dc7bf754f4d9a9c48b8579b46f26c, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=c6bef167110b40519ff4e31456803b09) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:04.110504 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38266ab6-9aa6-4908-bcab-91b326743f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:04.112045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38266ab6-9aa6-4908-bcab-91b326743f5c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:04.122389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 450/912] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:07:03 2022] GET /identity/v3/role_assignments?user.id=c6bef167110b40519ff4e31456803b09&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=343dc7bf754f4d9a9c48b8579b46f26c => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:04.337897 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201d1e9-06ad-4199-873b-86e85ce376cd None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:04.338280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201d1e9-06ad-4199-873b-86e85ce376cd None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:04.338525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201d1e9-06ad-4199-873b-86e85ce376cd None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:04.340400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 463/913] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:04.345841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ca98-9f45-4e80-8351-8d14ca420bc0 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:04.346349 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ca98-9f45-4e80-8351-8d14ca420bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:04.346443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ca98-9f45-4e80-8351-8d14ca420bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:04.367422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-2c28ca98-9f45-4e80-8351-8d14ca420bc0 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:04.368518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2c28ca98-9f45-4e80-8351-8d14ca420bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:04.441778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 451/914] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:04.465609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201d1e9-06ad-4199-873b-86e85ce376cd None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:04.576707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201d1e9-06ad-4199-873b-86e85ce376cd None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:04.592152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:04.613986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995296a-7eab-4d0c-ae9a-87b437e6415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:04.620984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995296a-7eab-4d0c-ae9a-87b437e6415f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:04.620984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995296a-7eab-4d0c-ae9a-87b437e6415f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:04.620984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995296a-7eab-4d0c-ae9a-87b437e6415f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:04.620984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995296a-7eab-4d0c-ae9a-87b437e6415f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:04.620984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995296a-7eab-4d0c-ae9a-87b437e6415f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3995296a-7eab-4d0c-ae9a-87b437e6415f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:04.626892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:04.627871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:04.628863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 464/915] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:07:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:04.636150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28ca98-9f45-4e80-8351-8d14ca420bc0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:04.720761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:04.742842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28ca98-9f45-4e80-8351-8d14ca420bc0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:04.778926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc08247-a30b-431f-97fa-8cea6af345d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:04.779560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc08247-a30b-431f-97fa-8cea6af345d9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:04.779835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc08247-a30b-431f-97fa-8cea6af345d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:04.780104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc08247-a30b-431f-97fa-8cea6af345d9 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:04.780779 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc08247-a30b-431f-97fa-8cea6af345d9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:04.781074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc08247-a30b-431f-97fa-8cea6af345d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:04.782458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc08247-a30b-431f-97fa-8cea6af345d9 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:04.787913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 452/916] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Aug 4 05:07:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:04.795456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995296a-7eab-4d0c-ae9a-87b437e6415f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:04.908797 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995296a-7eab-4d0c-ae9a-87b437e6415f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:04.944307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e7e97-0cc4-44b2-9adb-cc1884254015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:04.944921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e7e97-0cc4-44b2-9adb-cc1884254015 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:04.945254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e7e97-0cc4-44b2-9adb-cc1884254015 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:04.945525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e7e97-0cc4-44b2-9adb-cc1884254015 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:04.946244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e7e97-0cc4-44b2-9adb-cc1884254015 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:04.946620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e7e97-0cc4-44b2-9adb-cc1884254015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:04.947978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e7e97-0cc4-44b2-9adb-cc1884254015 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:04.954045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 465/917] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Aug 4 05:07:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:04.960002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc08247-a30b-431f-97fa-8cea6af345d9 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:05.002265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f196a3-e3c3-4668-b777-357121e37db5 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:05.002668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f196a3-e3c3-4668-b777-357121e37db5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:05.003086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f196a3-e3c3-4668-b777-357121e37db5 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:05.004739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 466/918] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:07:05.009641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773af37-21d5-4427-aeb0-c0ade268925d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:05.009987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773af37-21d5-4427-aeb0-c0ade268925d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:05.010354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773af37-21d5-4427-aeb0-c0ade268925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:05.028372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-5773af37-21d5-4427-aeb0-c0ade268925d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:05.029733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5773af37-21d5-4427-aeb0-c0ade268925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:05.070683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:05.078804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc08247-a30b-431f-97fa-8cea6af345d9 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:05.109530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 467/919] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:05.122845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d8d8d-12a9-4326-877f-8a65bcf6186f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:05.123710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d8d8d-12a9-4326-877f-8a65bcf6186f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:05.124176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d8d8d-12a9-4326-877f-8a65bcf6186f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:05.124661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d8d8d-12a9-4326-877f-8a65bcf6186f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:05.125580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d8d8d-12a9-4326-877f-8a65bcf6186f None admin] RBAC: Adding query filter params (interface=public, service_id=8d264b0436714b0f9954588d42e34bb8, region_id=RegionOne) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:05.126061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d8d8d-12a9-4326-877f-8a65bcf6186f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:05.127670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d8d8d-12a9-4326-877f-8a65bcf6186f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:05.131395 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773af37-21d5-4427-aeb0-c0ade268925d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:05.135781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 453/920] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 4 05:07:04 2022] GET /identity/v3/endpoints?service_id=8d264b0436714b0f9954588d42e34bb8&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:05.140841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d8d8d-12a9-4326-877f-8a65bcf6186f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:05.153938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:05.244812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773af37-21d5-4427-aeb0-c0ade268925d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:05.246018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d8d8d-12a9-4326-877f-8a65bcf6186f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:05.281966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c25a9-d109-46d0-a20e-7c72cae0456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:05.283557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c25a9-d109-46d0-a20e-7c72cae0456b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:05.283938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c25a9-d109-46d0-a20e-7c72cae0456b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:05.284233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a77782-604a-4bba-a02f-4191bf60cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:05.284414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c25a9-d109-46d0-a20e-7c72cae0456b None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:05.285208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c25a9-d109-46d0-a20e-7c72cae0456b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:05.285326 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77782-604a-4bba-a02f-4191bf60cddb None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:05.285742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77782-604a-4bba-a02f-4191bf60cddb None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:05.286160 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77782-604a-4bba-a02f-4191bf60cddb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:05.286955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a77782-604a-4bba-a02f-4191bf60cddb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:05.287069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c25a9-d109-46d0-a20e-7c72cae0456b None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:05.288689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a77782-604a-4bba-a02f-4191bf60cddb None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:05.302337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 454/921] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 4 05:07:05 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-01a77782-604a-4bba-a02f-4191bf60cddb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:05.302867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:05.303866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:05.304733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 468/922] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:07:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:05.310759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c25a9-d109-46d0-a20e-7c72cae0456b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:05.395068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:05.431029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c25a9-d109-46d0-a20e-7c72cae0456b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:05.470031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423673d-5959-4f6e-9b73-53f3acdb358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:05.470680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423673d-5959-4f6e-9b73-53f3acdb358c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:05.470958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423673d-5959-4f6e-9b73-53f3acdb358c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:05.471229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423673d-5959-4f6e-9b73-53f3acdb358c None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:05.471902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423673d-5959-4f6e-9b73-53f3acdb358c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:05.472206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423673d-5959-4f6e-9b73-53f3acdb358c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:05.473586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423673d-5959-4f6e-9b73-53f3acdb358c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:05.478942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 455/923] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:07:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:05.485402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a77782-604a-4bba-a02f-4191bf60cddb None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:05.523318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:05.597691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a77782-604a-4bba-a02f-4191bf60cddb None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:05.634346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853bb9-0010-4239-a672-378193b8bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:05.635376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853bb9-0010-4239-a672-378193b8bd43 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:05.635891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853bb9-0010-4239-a672-378193b8bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:05.636921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853bb9-0010-4239-a672-378193b8bd43 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:05.637805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853bb9-0010-4239-a672-378193b8bd43 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:05.638395 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853bb9-0010-4239-a672-378193b8bd43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:05.639977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853bb9-0010-4239-a672-378193b8bd43 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:05.645796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 469/924] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Aug 4 05:07:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:05.651300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423673d-5959-4f6e-9b73-53f3acdb358c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:05.768492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423673d-5959-4f6e-9b73-53f3acdb358c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:05.782331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e235a7-5318-44fe-8bf0-a6db8c9003eb None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:05.783283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e235a7-5318-44fe-8bf0-a6db8c9003eb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:05.783805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e235a7-5318-44fe-8bf0-a6db8c9003eb None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:05.786838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 470/925] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:05.791931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad64e99-7003-4ad9-88fb-bcef6b92faee None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:05.792214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad64e99-7003-4ad9-88fb-bcef6b92faee None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:05.792494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad64e99-7003-4ad9-88fb-bcef6b92faee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:05.810920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d622c-5a84-43a3-829a-37c2ff6b71fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:05.812002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d622c-5a84-43a3-829a-37c2ff6b71fd None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:05.812491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d622c-5a84-43a3-829a-37c2ff6b71fd None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:05.812624 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-2ad64e99-7003-4ad9-88fb-bcef6b92faee None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:05.813128 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d622c-5a84-43a3-829a-37c2ff6b71fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:05.813699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2ad64e99-7003-4ad9-88fb-bcef6b92faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:05.814369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d622c-5a84-43a3-829a-37c2ff6b71fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:05.816297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d622c-5a84-43a3-829a-37c2ff6b71fd None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:05.823077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:05.897281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 471/926] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:05.916457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad64e99-7003-4ad9-88fb-bcef6b92faee None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:05.921299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 456/927] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:07:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:05.951899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:06.038502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad64e99-7003-4ad9-88fb-bcef6b92faee None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:06.083400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5529d-2d6e-4803-9d4b-a654e9816401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:06.084043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5529d-2d6e-4803-9d4b-a654e9816401 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:06.084323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5529d-2d6e-4803-9d4b-a654e9816401 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:06.084593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5529d-2d6e-4803-9d4b-a654e9816401 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:06.085347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5529d-2d6e-4803-9d4b-a654e9816401 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:06.087937 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5529d-2d6e-4803-9d4b-a654e9816401 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-7df5529d-2d6e-4803-9d4b-a654e9816401 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:06.096736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:06.097700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:06.098560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 472/928] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Aug 4 05:07:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:06.104391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d622c-5a84-43a3-829a-37c2ff6b71fd None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:06.224374 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d622c-5a84-43a3-829a-37c2ff6b71fd None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:06.262545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7aaa-9c70-4557-a26c-4e1e5fb75265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:06.263183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7aaa-9c70-4557-a26c-4e1e5fb75265 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:06.263467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7aaa-9c70-4557-a26c-4e1e5fb75265 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:06.263746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7aaa-9c70-4557-a26c-4e1e5fb75265 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:06.264430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7aaa-9c70-4557-a26c-4e1e5fb75265 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:06.264736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7aaa-9c70-4557-a26c-4e1e5fb75265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:06.266123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7aaa-9c70-4557-a26c-4e1e5fb75265 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:06.271845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 457/929] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:07:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:06.277593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5529d-2d6e-4803-9d4b-a654e9816401 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:06.308881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5594272-88bb-4fd9-a2a8-e64d2532c010 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:06.309188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5594272-88bb-4fd9-a2a8-e64d2532c010 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:06.309435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5594272-88bb-4fd9-a2a8-e64d2532c010 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:06.311567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 458/930] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:07:06.318907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e49086-d135-478f-80ba-2a22e05f2efb None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:06.319322 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e49086-d135-478f-80ba-2a22e05f2efb None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:06.319704 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e49086-d135-478f-80ba-2a22e05f2efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:06.339028 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-36e49086-d135-478f-80ba-2a22e05f2efb None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:06.340764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-36e49086-d135-478f-80ba-2a22e05f2efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:06.381510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:06.393623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5529d-2d6e-4803-9d4b-a654e9816401 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:06.404994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:06.435270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a6d59-01a1-4b9a-b295-59a29d7998dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:06.435584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 459/931] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:06.436445 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a6d59-01a1-4b9a-b295-59a29d7998dd None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:06.436982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a6d59-01a1-4b9a-b295-59a29d7998dd None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:06.437416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a6d59-01a1-4b9a-b295-59a29d7998dd None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:06.438255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a6d59-01a1-4b9a-b295-59a29d7998dd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:06.440306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a6d59-01a1-4b9a-b295-59a29d7998dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:06.443073 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a6d59-01a1-4b9a-b295-59a29d7998dd None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:06.453703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 473/932] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:07:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:06.463465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e49086-d135-478f-80ba-2a22e05f2efb None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:06.465550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a6d59-01a1-4b9a-b295-59a29d7998dd None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:06.592687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a6d59-01a1-4b9a-b295-59a29d7998dd None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:06.601459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e49086-d135-478f-80ba-2a22e05f2efb None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:06.639632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662bf0a-e67a-4f61-bc5f-53241baff0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:06.641084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662bf0a-e67a-4f61-bc5f-53241baff0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:06.641716 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662bf0a-e67a-4f61-bc5f-53241baff0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:06.642294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662bf0a-e67a-4f61-bc5f-53241baff0a0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:06.643465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf6579-31a4-4964-a92b-0719537810af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:06.644096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf6579-31a4-4964-a92b-0719537810af None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:06.644434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf6579-31a4-4964-a92b-0719537810af None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:06.644713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf6579-31a4-4964-a92b-0719537810af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:06.645919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf6579-31a4-4964-a92b-0719537810af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:06.647918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf6579-31a4-4964-a92b-0719537810af None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:06.657537 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662bf0a-e67a-4f61-bc5f-53241baff0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-f662bf0a-e67a-4f61-bc5f-53241baff0a0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:06.664472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:06.665467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:06.666327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:06.669660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 474/933] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Aug 4 05:07:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:06.676356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662bf0a-e67a-4f61-bc5f-53241baff0a0 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:06.697585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:06.752956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 460/934] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:07:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:06.823547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662bf0a-e67a-4f61-bc5f-53241baff0a0 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:06.879116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f32b2b-c7d8-4664-b3bd-3873ecbb0f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:06.880048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32b2b-c7d8-4664-b3bd-3873ecbb0f41 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:06.880512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32b2b-c7d8-4664-b3bd-3873ecbb0f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:06.880984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32b2b-c7d8-4664-b3bd-3873ecbb0f41 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:06.881934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f32b2b-c7d8-4664-b3bd-3873ecbb0f41 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:06.882242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f32b2b-c7d8-4664-b3bd-3873ecbb0f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:06.883866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f32b2b-c7d8-4664-b3bd-3873ecbb0f41 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:06.894175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 475/935] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Aug 4 05:07:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:06.902836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf6579-31a4-4964-a92b-0719537810af None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:06.958913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:07.029117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf6579-31a4-4964-a92b-0719537810af None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:07.067866 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27b3fa-338d-443d-a2af-65720d2318f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:07.068671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27b3fa-338d-443d-a2af-65720d2318f6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:07.068956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27b3fa-338d-443d-a2af-65720d2318f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:07.069226 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27b3fa-338d-443d-a2af-65720d2318f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:07.081643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27b3fa-338d-443d-a2af-65720d2318f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:07.083991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27b3fa-338d-443d-a2af-65720d2318f6 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-9b27b3fa-338d-443d-a2af-65720d2318f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:07.101590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:07.102655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:07.103980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:07.103980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:07.103980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:07.103980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:07.103980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 461/936] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:07.110152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f32b2b-c7d8-4664-b3bd-3873ecbb0f41 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:07.194687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:07.230388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f32b2b-c7d8-4664-b3bd-3873ecbb0f41 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:07.271295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4a609-ff15-458f-9b65-b835ec220c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:07.272337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4a609-ff15-458f-9b65-b835ec220c73 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:07.272845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4a609-ff15-458f-9b65-b835ec220c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:07.273330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4a609-ff15-458f-9b65-b835ec220c73 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:07.274406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4a609-ff15-458f-9b65-b835ec220c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:07.274959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4a609-ff15-458f-9b65-b835ec220c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:07.276707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4a609-ff15-458f-9b65-b835ec220c73 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:07.293082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 476/937] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:07.299459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27b3fa-338d-443d-a2af-65720d2318f6 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:07.399276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:07.406125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27b3fa-338d-443d-a2af-65720d2318f6 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:07.441735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305496f5-75da-433a-aca4-6956d1b3ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:07.442291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305496f5-75da-433a-aca4-6956d1b3ca1a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:07.442591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305496f5-75da-433a-aca4-6956d1b3ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:07.442862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305496f5-75da-433a-aca4-6956d1b3ca1a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:07.450664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305496f5-75da-433a-aca4-6956d1b3ca1a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:07.452228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305496f5-75da-433a-aca4-6956d1b3ca1a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-305496f5-75da-433a-aca4-6956d1b3ca1a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:07:07.465117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:07.466969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:07.468835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 462/938] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 4 05:07:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:07.472379 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4a609-ff15-458f-9b65-b835ec220c73 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:07.581295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4a609-ff15-458f-9b65-b835ec220c73 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:07.612418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:07.618625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0f462-2d44-4de3-8d56-2879370e976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:07.625494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f462-2d44-4de3-8d56-2879370e976a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:07.625494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f462-2d44-4de3-8d56-2879370e976a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:07.625494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f462-2d44-4de3-8d56-2879370e976a None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:07.625494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0f462-2d44-4de3-8d56-2879370e976a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:07.625494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0f462-2d44-4de3-8d56-2879370e976a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:07.625494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0f462-2d44-4de3-8d56-2879370e976a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:07.642355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 477/939] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Aug 4 05:07:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:07.648100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305496f5-75da-433a-aca4-6956d1b3ca1a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:07.659799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c8fb8-4ad1-455f-bbc6-db4d28021523 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:07.660138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c8fb8-4ad1-455f-bbc6-db4d28021523 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:07.660357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c8fb8-4ad1-455f-bbc6-db4d28021523 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:07.661961 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 478/940] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:07:07.666856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638b3ab-b5d0-407b-a7a9-729f3ec945de None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:07.667128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638b3ab-b5d0-407b-a7a9-729f3ec945de None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:07.667394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638b3ab-b5d0-407b-a7a9-729f3ec945de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:07.700401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b638b3ab-b5d0-407b-a7a9-729f3ec945de None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:07.701935 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b638b3ab-b5d0-407b-a7a9-729f3ec945de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:07.772659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305496f5-75da-433a-aca4-6956d1b3ca1a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:07.794040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 479/941] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:07.817891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0fba6-8120-44d4-8c5c-5d83a0611965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:07.818579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0fba6-8120-44d4-8c5c-5d83a0611965 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:07.818812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0fba6-8120-44d4-8c5c-5d83a0611965 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:07.819143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0fba6-8120-44d4-8c5c-5d83a0611965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:07.820188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638b3ab-b5d0-407b-a7a9-729f3ec945de None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:07.831319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0fba6-8120-44d4-8c5c-5d83a0611965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:07.832600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0fba6-8120-44d4-8c5c-5d83a0611965 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-6ea0fba6-8120-44d4-8c5c-5d83a0611965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:07.848463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:07.849405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:07.850286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:07.850286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:07.850286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:07.850286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:07.850286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 463/942] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:07.857824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0fba6-8120-44d4-8c5c-5d83a0611965 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:07.861862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:07.934293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638b3ab-b5d0-407b-a7a9-729f3ec945de None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:07.956190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:07.977910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebd310-8354-40f4-bcac-0c6255448036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:07.978667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0fba6-8120-44d4-8c5c-5d83a0611965 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:07.978892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd310-8354-40f4-bcac-0c6255448036 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:07.979269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd310-8354-40f4-bcac-0c6255448036 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:07.979691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd310-8354-40f4-bcac-0c6255448036 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:07.980521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebd310-8354-40f4-bcac-0c6255448036 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:07.983355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebd310-8354-40f4-bcac-0c6255448036 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-96ebd310-8354-40f4-bcac-0c6255448036 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:07.997111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:07.998237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:07.999213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:08.002508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 480/943] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:07:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:08.005743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebd310-8354-40f4-bcac-0c6255448036 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:08.028234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f204b9c-3132-4fb4-b280-c64582f702be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:08.028744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204b9c-3132-4fb4-b280-c64582f702be None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.029028 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204b9c-3132-4fb4-b280-c64582f702be None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.029345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204b9c-3132-4fb4-b280-c64582f702be None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.030055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f204b9c-3132-4fb4-b280-c64582f702be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:08.030379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f204b9c-3132-4fb4-b280-c64582f702be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:08.031752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f204b9c-3132-4fb4-b280-c64582f702be None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:08.046347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 464/944] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:08.052865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f204b9c-3132-4fb4-b280-c64582f702be None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:08.120364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:08.129220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebd310-8354-40f4-bcac-0c6255448036 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:08.165444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f204b9c-3132-4fb4-b280-c64582f702be None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:08.179501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4bc40-67e6-4033-8092-bdb0b879d6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:08.180372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4bc40-67e6-4033-8092-bdb0b879d6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.180875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4bc40-67e6-4033-8092-bdb0b879d6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.181339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4bc40-67e6-4033-8092-bdb0b879d6e2 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.182238 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4bc40-67e6-4033-8092-bdb0b879d6e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:08.182835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4bc40-67e6-4033-8092-bdb0b879d6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:08.185067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4bc40-67e6-4033-8092-bdb0b879d6e2 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:08.195198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 481/945] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Aug 4 05:07:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:08.196298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4bc40-67e6-4033-8092-bdb0b879d6e2 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:08.201702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720502-0c1e-4840-94d1-f62e91b9a4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:08.202608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720502-0c1e-4840-94d1-f62e91b9a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.202960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720502-0c1e-4840-94d1-f62e91b9a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.203325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720502-0c1e-4840-94d1-f62e91b9a4f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.210791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1720502-0c1e-4840-94d1-f62e91b9a4f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:08.212303 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1720502-0c1e-4840-94d1-f62e91b9a4f0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-a1720502-0c1e-4840-94d1-f62e91b9a4f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:07:08.225017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:08.225969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:08.226941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:07:08.226941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:07:08.226941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:07:08.226941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:07:08.226941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:07:08.226941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:07:08.226941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:08.226941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:08.232343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 465/946] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:07:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:08.233547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720502-0c1e-4840-94d1-f62e91b9a4f0 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:08.252924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:08.313541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4bc40-67e6-4033-8092-bdb0b879d6e2 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:08.345556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720502-0c1e-4840-94d1-f62e91b9a4f0 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:08.357159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46184523-e52f-47c0-8505-2c3162f6ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:08.357788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46184523-e52f-47c0-8505-2c3162f6ff30 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.358062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46184523-e52f-47c0-8505-2c3162f6ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.358362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46184523-e52f-47c0-8505-2c3162f6ff30 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.359037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46184523-e52f-47c0-8505-2c3162f6ff30 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:08.359340 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46184523-e52f-47c0-8505-2c3162f6ff30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:08.360694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46184523-e52f-47c0-8505-2c3162f6ff30 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:08.365959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 482/947] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Aug 4 05:07:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:08.367262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d155c77-b42c-4fce-9f00-cd8e91e2731f None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.367555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d155c77-b42c-4fce-9f00-cd8e91e2731f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.367829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d155c77-b42c-4fce-9f00-cd8e91e2731f None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.369221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 483/948] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:08.373921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d155c77-b42c-4fce-9f00-cd8e91e2731f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:08.376170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:08.388556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dfcd3-5d62-4177-8eb5-fcf9f6d782a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:08.389176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dfcd3-5d62-4177-8eb5-fcf9f6d782a0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.394192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dfcd3-5d62-4177-8eb5-fcf9f6d782a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.394192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dfcd3-5d62-4177-8eb5-fcf9f6d782a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.394192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dfcd3-5d62-4177-8eb5-fcf9f6d782a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:08.394192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dfcd3-5d62-4177-8eb5-fcf9f6d782a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:08.394192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dfcd3-5d62-4177-8eb5-fcf9f6d782a0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:08.406218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 466/949] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:07:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:08.406218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836063b8-d129-474e-8c46-a59cd3ffa445 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.406218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836063b8-d129-474e-8c46-a59cd3ffa445 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.406218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836063b8-d129-474e-8c46-a59cd3ffa445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.428797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-836063b8-d129-474e-8c46-a59cd3ffa445 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:08.429975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-836063b8-d129-474e-8c46-a59cd3ffa445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:08.493080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d155c77-b42c-4fce-9f00-cd8e91e2731f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:08.504050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:08.507697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 467/950] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:08.508524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836063b8-d129-474e-8c46-a59cd3ffa445 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:08.543684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b75ab-6f0d-4b99-829d-edf1e6b9974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:08.544464 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b75ab-6f0d-4b99-829d-edf1e6b9974f None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.544804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b75ab-6f0d-4b99-829d-edf1e6b9974f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.545151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b75ab-6f0d-4b99-829d-edf1e6b9974f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.545944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b75ab-6f0d-4b99-829d-edf1e6b9974f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:08.547568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b75ab-6f0d-4b99-829d-edf1e6b9974f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:08.617377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836063b8-d129-474e-8c46-a59cd3ffa445 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:08.633045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:08.633596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 484/951] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:07:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:08.635446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b75ab-6f0d-4b99-829d-edf1e6b9974f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:08.671392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f688cf8-699f-47cb-9e9d-a15c3fdc373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:08.673104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f688cf8-699f-47cb-9e9d-a15c3fdc373a None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.673104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f688cf8-699f-47cb-9e9d-a15c3fdc373a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.673104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f688cf8-699f-47cb-9e9d-a15c3fdc373a None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/c6bef167110b40519ff4e31456803b09/roles/343dc7bf754f4d9a9c48b8579b46f26c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.675437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f688cf8-699f-47cb-9e9d-a15c3fdc373a None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=c6bef167110b40519ff4e31456803b09, role_id=343dc7bf754f4d9a9c48b8579b46f26c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:08.676900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f688cf8-699f-47cb-9e9d-a15c3fdc373a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:08.772083 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 468/952] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:07:08 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/c6bef167110b40519ff4e31456803b09/roles/343dc7bf754f4d9a9c48b8579b46f26c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:07:08.798733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b75ab-6f0d-4b99-829d-edf1e6b9974f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:08.842682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7d16b-9bdb-4080-b92c-4923aad43a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:08.843675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7d16b-9bdb-4080-b92c-4923aad43a50 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.843951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7d16b-9bdb-4080-b92c-4923aad43a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.844218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7d16b-9bdb-4080-b92c-4923aad43a50 None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.844913 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7d16b-9bdb-4080-b92c-4923aad43a50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:08.846418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7d16b-9bdb-4080-b92c-4923aad43a50 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:08.849125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WARNING keystone.server.flask.common [None req-eec7d16b-9bdb-4080-b92c-4923aad43a50 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 05:07:08.904411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.sql.core [None req-eec7d16b-9bdb-4080-b92c-4923aad43a50 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 05:07:08.904411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 05:07:08.904411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [parameters: {'id': 'c7a4eab195604a99bc655aa70ecc4089', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 05:07:08.904411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80698) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-eec7d16b-9bdb-4080-b92c-4923aad43a50 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7a4eab195604a99bc655aa70ecc4089.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7a4eab195604a99bc655aa70ecc4089. Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application conn.query(q) Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 05:07:08.923335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application result.read() Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 04 05:07:08.924223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application next(self.gen) Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application yield resource Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application next(self.gen) Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise self.value Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application session.commit() Aug 04 05:07:08.925197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self.session.flush() Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application compat.raise_( Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 05:07:08.926145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 05:07:08.927064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application conn.query(q) Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application result.read() Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 05:07:08.927848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [parameters: {'id': 'c7a4eab195604a99bc655aa70ecc4089', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:08.928702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:08.929687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:08.931051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:08.931051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 04 05:07:08.931051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 04 05:07:08.931051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:08.931051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:08.931051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 04 05:07:08.931051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 04 05:07:08.931051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7a4eab195604a99bc655aa70ecc4089. Aug 04 05:07:08.931051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:08.931051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 485/953] 10.222.0.46 () {60 vars in 1140 bytes} [Thu Aug 4 05:07:08 2022] POST /identity/v3/projects => generated 262 bytes in 290 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:08.931744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f688cf8-699f-47cb-9e9d-a15c3fdc373a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:08.940411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63785d-47b1-4e45-b51e-85fd0594b2ec None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.940716 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63785d-47b1-4e45-b51e-85fd0594b2ec None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.940959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63785d-47b1-4e45-b51e-85fd0594b2ec None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.945420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 486/954] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:08.952013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d62a6-d5a4-418d-aa2f-498957c5e96d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:08.952357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d62a6-d5a4-418d-aa2f-498957c5e96d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:08.952633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d62a6-d5a4-418d-aa2f-498957c5e96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:08.974858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-2f4d62a6-d5a4-418d-aa2f-498957c5e96d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:08.976371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2f4d62a6-d5a4-418d-aa2f-498957c5e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:08.995000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:09.050680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 487/955] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:09.064074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f688cf8-699f-47cb-9e9d-a15c3fdc373a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:09.076819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d62a6-d5a4-418d-aa2f-498957c5e96d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:09.102504 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e593f-8f3a-4c3d-824a-aa9f3680ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:09.103250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e593f-8f3a-4c3d-824a-aa9f3680ac60 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:09.103593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e593f-8f3a-4c3d-824a-aa9f3680ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:09.103944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e593f-8f3a-4c3d-824a-aa9f3680ac60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:09.111872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e593f-8f3a-4c3d-824a-aa9f3680ac60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:09.113438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e593f-8f3a-4c3d-824a-aa9f3680ac60 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-e49e593f-8f3a-4c3d-824a-aa9f3680ac60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:07:09.125506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:09.126610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:09.127661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:07:09.127661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:07:09.127661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:07:09.127661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:07:09.127661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:07:09.127661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:07:09.127661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:09.127661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:09.127661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 469/956] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:07:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:09.132541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e593f-8f3a-4c3d-824a-aa9f3680ac60 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:09.179608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:09.199393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d62a6-d5a4-418d-aa2f-498957c5e96d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:09.243026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f4d2e-a449-47c8-a2d4-f856a023e0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:09.244022 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4d2e-a449-47c8-a2d4-f856a023e0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:09.244330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4d2e-a449-47c8-a2d4-f856a023e0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:09.244607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f4d2e-a449-47c8-a2d4-f856a023e0a5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:09.245248 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f4d2e-a449-47c8-a2d4-f856a023e0a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:09.247852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f4d2e-a449-47c8-a2d4-f856a023e0a5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-601f4d2e-a449-47c8-a2d4-f856a023e0a5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:09.259162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:09.260258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 05:07:09.261189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:09.264698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 488/957] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:07:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:09.271717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f4d2e-a449-47c8-a2d4-f856a023e0a5 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:09.278358 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e593f-8f3a-4c3d-824a-aa9f3680ac60 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:09.292853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:09.317177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2216cf-b401-4cfc-99f5-3799f77a70db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:09.317710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2216cf-b401-4cfc-99f5-3799f77a70db None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:09.317985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2216cf-b401-4cfc-99f5-3799f77a70db None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:09.318272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2216cf-b401-4cfc-99f5-3799f77a70db None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:09.319021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2216cf-b401-4cfc-99f5-3799f77a70db None admin] RBAC: Adding query filter params (name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:09.319325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2216cf-b401-4cfc-99f5-3799f77a70db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:09.321266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2216cf-b401-4cfc-99f5-3799f77a70db None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:09.346145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 470/958] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:07:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:09.396553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f4d2e-a449-47c8-a2d4-f856a023e0a5 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:09.440769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4f14a-c8b9-4f06-b278-3bebc0607f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:09.441650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4f14a-c8b9-4f06-b278-3bebc0607f5a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:09.442099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4f14a-c8b9-4f06-b278-3bebc0607f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:09.442544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4f14a-c8b9-4f06-b278-3bebc0607f5a None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:09.443396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4f14a-c8b9-4f06-b278-3bebc0607f5a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:09.443862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4f14a-c8b9-4f06-b278-3bebc0607f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:09.445519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4f14a-c8b9-4f06-b278-3bebc0607f5a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:09.452597 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 489/959] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:07:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:09.459585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2216cf-b401-4cfc-99f5-3799f77a70db None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:09.574601 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:09.585032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2216cf-b401-4cfc-99f5-3799f77a70db None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:09.621904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc8e65-90cf-4b66-b644-d02443787e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:09.622567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8e65-90cf-4b66-b644-d02443787e22 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:09.622839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8e65-90cf-4b66-b644-d02443787e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:09.623112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc8e65-90cf-4b66-b644-d02443787e22 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:09.623797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8e65-90cf-4b66-b644-d02443787e22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:09.624140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8e65-90cf-4b66-b644-d02443787e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:09.625564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc8e65-90cf-4b66-b644-d02443787e22 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:09.630887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 471/960] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:07:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:10.809468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91ddc8-85ed-49f1-91d0-ed67676cd364 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:10.809991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91ddc8-85ed-49f1-91d0-ed67676cd364 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:10.809991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91ddc8-85ed-49f1-91d0-ed67676cd364 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:10.811639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 490/961] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:10.816954 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c4a94-e730-4cfb-857c-0d68ce7b83bc None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:10.817411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c4a94-e730-4cfb-857c-0d68ce7b83bc None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:10.817492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c4a94-e730-4cfb-857c-0d68ce7b83bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:10.837059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-894c4a94-e730-4cfb-857c-0d68ce7b83bc None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:10.838588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-894c4a94-e730-4cfb-857c-0d68ce7b83bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:10.910420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 472/962] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:10.922289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689a50-db36-4d63-9c32-9c8fc8d1bbf7 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:10.922612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689a50-db36-4d63-9c32-9c8fc8d1bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:10.922877 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689a50-db36-4d63-9c32-9c8fc8d1bbf7 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:10.925491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 491/963] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:10.930062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c3aff-c4c8-48fc-9625-6fc4fd94096e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:10.930386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c3aff-c4c8-48fc-9625-6fc4fd94096e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:10.930670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c3aff-c4c8-48fc-9625-6fc4fd94096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:10.935520 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689a50-db36-4d63-9c32-9c8fc8d1bbf7 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:10.952676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-847c3aff-c4c8-48fc-9625-6fc4fd94096e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:10.954140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-847c3aff-c4c8-48fc-9625-6fc4fd94096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:11.030390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:11.046414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 473/964] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:11.053188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689a50-db36-4d63-9c32-9c8fc8d1bbf7 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:11.066176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c3aff-c4c8-48fc-9625-6fc4fd94096e None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:11.082809 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:11.099664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e426bd-5977-47e4-a274-3d2d2eb74b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:11.100561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e426bd-5977-47e4-a274-3d2d2eb74b2a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.100839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e426bd-5977-47e4-a274-3d2d2eb74b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.101111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e426bd-5977-47e4-a274-3d2d2eb74b2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.101735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e426bd-5977-47e4-a274-3d2d2eb74b2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:11.103297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e426bd-5977-47e4-a274-3d2d2eb74b2a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-c1e426bd-5977-47e4-a274-3d2d2eb74b2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:11.115494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:11.116668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:11.117552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 492/965] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:07:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:11.123691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e426bd-5977-47e4-a274-3d2d2eb74b2a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:11.184830 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c3aff-c4c8-48fc-9625-6fc4fd94096e None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:11.223641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d584b26-54af-4ec8-a5b1-d303a079d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:11.224504 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d584b26-54af-4ec8-a5b1-d303a079d182 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.224857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d584b26-54af-4ec8-a5b1-d303a079d182 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.225204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d584b26-54af-4ec8-a5b1-d303a079d182 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.227400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e426bd-5977-47e4-a274-3d2d2eb74b2a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:11.237838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d584b26-54af-4ec8-a5b1-d303a079d182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-5d584b26-54af-4ec8-a5b1-d303a079d182 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:11.243300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:11.244271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:11.245806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:11.250010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 474/966] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Aug 4 05:07:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:11.251334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d584b26-54af-4ec8-a5b1-d303a079d182 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:11.263194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e43f7-25c4-4321-abcf-f04a471f5a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:11.263825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e43f7-25c4-4321-abcf-f04a471f5a0d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.264082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e43f7-25c4-4321-abcf-f04a471f5a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.264354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e43f7-25c4-4321-abcf-f04a471f5a0d None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.265026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e43f7-25c4-4321-abcf-f04a471f5a0d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:11.265322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e43f7-25c4-4321-abcf-f04a471f5a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:11.266720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e43f7-25c4-4321-abcf-f04a471f5a0d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:11.276547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 493/967] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Aug 4 05:07:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:11.277946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e43f7-25c4-4321-abcf-f04a471f5a0d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:11.289027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:11.337534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:11.367916 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d584b26-54af-4ec8-a5b1-d303a079d182 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:11.381038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e43f7-25c4-4321-abcf-f04a471f5a0d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:11.407933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f29c9-6992-4407-825a-7d1c476c1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:11.408933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f29c9-6992-4407-825a-7d1c476c1d94 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.409361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f29c9-6992-4407-825a-7d1c476c1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.409787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f29c9-6992-4407-825a-7d1c476c1d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.410787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f29c9-6992-4407-825a-7d1c476c1d94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:11.411242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f29c9-6992-4407-825a-7d1c476c1d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:11.412843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f29c9-6992-4407-825a-7d1c476c1d94 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:11.416291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c2f03-f07d-4635-838c-c59d8c8b0d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:11.416897 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c2f03-f07d-4635-838c-c59d8c8b0d58 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.417172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c2f03-f07d-4635-838c-c59d8c8b0d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.417440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c2f03-f07d-4635-838c-c59d8c8b0d58 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.418700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c2f03-f07d-4635-838c-c59d8c8b0d58 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:11.419168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c2f03-f07d-4635-838c-c59d8c8b0d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:11.420648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c2f03-f07d-4635-838c-c59d8c8b0d58 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:11.429075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 475/968] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Aug 4 05:07:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:11.430675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 494/969] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Aug 4 05:07:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:11.431031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f29c9-6992-4407-825a-7d1c476c1d94 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:11.431711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c2f03-f07d-4635-838c-c59d8c8b0d58 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:11.503255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:11.534339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c2f03-f07d-4635-838c-c59d8c8b0d58 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:11.552085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f29c9-6992-4407-825a-7d1c476c1d94 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:11.569353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b07f73-5374-43f2-8ab7-09a94d314993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:11.569951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b07f73-5374-43f2-8ab7-09a94d314993 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.570225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b07f73-5374-43f2-8ab7-09a94d314993 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.570515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b07f73-5374-43f2-8ab7-09a94d314993 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.571270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b07f73-5374-43f2-8ab7-09a94d314993 None admin] RBAC: Adding query filter params (interface=admin, service_id=8d264b0436714b0f9954588d42e34bb8, region_id=RegionOne) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:11.571587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b07f73-5374-43f2-8ab7-09a94d314993 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:11.572915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b07f73-5374-43f2-8ab7-09a94d314993 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:11.582414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 495/970] 10.222.0.46 () {56 vars in 1249 bytes} [Thu Aug 4 05:07:11 2022] GET /identity/v3/endpoints?service_id=8d264b0436714b0f9954588d42e34bb8&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:11.583979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557806-9233-4225-9784-5e6fcbcc9b61 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.584269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557806-9233-4225-9784-5e6fcbcc9b61 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.584541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557806-9233-4225-9784-5e6fcbcc9b61 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.585856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 496/971] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:11.586564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26557806-9233-4225-9784-5e6fcbcc9b61 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:11.594903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd529e-2878-4372-9680-ffb57ab3a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:11.595779 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd529e-2878-4372-9680-ffb57ab3a112 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.596295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd529e-2878-4372-9680-ffb57ab3a112 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.596722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd529e-2878-4372-9680-ffb57ab3a112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.599960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:11.609405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd529e-2878-4372-9680-ffb57ab3a112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:11.611020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd529e-2878-4372-9680-ffb57ab3a112 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-4abd529e-2878-4372-9680-ffb57ab3a112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:11.626266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:11.627263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:11.628186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:11.628186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:11.628186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:11.628186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:11.628186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 476/972] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:11.631596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669739b-8923-4a1a-bcdc-a936f1553e05 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.632101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669739b-8923-4a1a-bcdc-a936f1553e05 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.632696 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669739b-8923-4a1a-bcdc-a936f1553e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.653702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b669739b-8923-4a1a-bcdc-a936f1553e05 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:11.655443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b669739b-8923-4a1a-bcdc-a936f1553e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:11.699738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26557806-9233-4225-9784-5e6fcbcc9b61 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:11.733144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 477/973] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:11.733770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669739b-8923-4a1a-bcdc-a936f1553e05 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:11.738265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5156fe9-259c-4a9b-8ddb-d1969f5d29ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:11.739019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5156fe9-259c-4a9b-8ddb-d1969f5d29ff None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.739308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5156fe9-259c-4a9b-8ddb-d1969f5d29ff None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.739609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5156fe9-259c-4a9b-8ddb-d1969f5d29ff None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.740261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5156fe9-259c-4a9b-8ddb-d1969f5d29ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:11.741625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5156fe9-259c-4a9b-8ddb-d1969f5d29ff None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:11.748061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 497/974] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 4 05:07:11 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:07:11.749114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e789-0da3-443f-8667-c272cd5b3193 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.749394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e789-0da3-443f-8667-c272cd5b3193 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.754568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e789-0da3-443f-8667-c272cd5b3193 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.754568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:11.755727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 498/975] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:11.757155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05804f4-6e94-43e6-9989-1d24e2b3a2c1 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.757444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05804f4-6e94-43e6-9989-1d24e2b3a2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.757719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05804f4-6e94-43e6-9989-1d24e2b3a2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.779040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c05804f4-6e94-43e6-9989-1d24e2b3a2c1 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:11.780301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c05804f4-6e94-43e6-9989-1d24e2b3a2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:11.862638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 499/976] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:11.863382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669739b-8923-4a1a-bcdc-a936f1553e05 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:11.872219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05804f4-6e94-43e6-9989-1d24e2b3a2c1 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:11.884795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:11.904695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6745715-8784-4cd8-a3ab-cc69cc6f02d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:11.905434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6745715-8784-4cd8-a3ab-cc69cc6f02d9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:11.905623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6745715-8784-4cd8-a3ab-cc69cc6f02d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:11.905886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6745715-8784-4cd8-a3ab-cc69cc6f02d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:11.906628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6745715-8784-4cd8-a3ab-cc69cc6f02d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:11.906934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6745715-8784-4cd8-a3ab-cc69cc6f02d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:11.908327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6745715-8784-4cd8-a3ab-cc69cc6f02d9 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:11.920735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 478/977] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:11.921687 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6745715-8784-4cd8-a3ab-cc69cc6f02d9 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:11.993955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05804f4-6e94-43e6-9989-1d24e2b3a2c1 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:12.028741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:12.035169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae043ddc-a014-4d7a-81b2-e9824e0af831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:12.035791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae043ddc-a014-4d7a-81b2-e9824e0af831 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:12.036065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae043ddc-a014-4d7a-81b2-e9824e0af831 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:12.036340 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae043ddc-a014-4d7a-81b2-e9824e0af831 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:12.037009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae043ddc-a014-4d7a-81b2-e9824e0af831 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:12.038557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae043ddc-a014-4d7a-81b2-e9824e0af831 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:12.040939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6745715-8784-4cd8-a3ab-cc69cc6f02d9 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:12.077906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ce01e-0f82-4532-96d7-c7d8dedbf923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:12.078553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ce01e-0f82-4532-96d7-c7d8dedbf923 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:12.078829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ce01e-0f82-4532-96d7-c7d8dedbf923 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:12.079103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ce01e-0f82-4532-96d7-c7d8dedbf923 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:12.079791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ce01e-0f82-4532-96d7-c7d8dedbf923 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:12.081137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ce01e-0f82-4532-96d7-c7d8dedbf923 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:12.105922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.sql.core [None req-ae043ddc-a014-4d7a-81b2-e9824e0af831 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 05:07:12.105922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 05:07:12.105922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [parameters: {'user_id': '2c8e05c4aad04400a4857dadf47f1484', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 05:07:12.105922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80698) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-ae043ddc-a014-4d7a-81b2-e9824e0af831 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application conn.query(q) Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application result.read() Aug 04 05:07:12.113666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 05:07:12.114750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application next(self.gen) Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application yield resource Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application next(self.gen) Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise self.value Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application session.commit() Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 05:07:12.115757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self.session.flush() Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application compat.raise_( Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 05:07:12.116675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 05:07:12.117555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application conn.query(q) Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application result.read() Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 05:07:12.125501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [parameters: {'user_id': '2c8e05c4aad04400a4857dadf47f1484', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:12.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 04 05:07:12.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 04 05:07:12.128200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 04 05:07:12.128200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 04 05:07:12.128200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 05:07:12.128200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 05:07:12.128200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 05:07:12.128200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:12.128200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 500/978] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Aug 4 05:07:11 2022] POST /identity/v3/users => generated 160 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:12.128200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae043ddc-a014-4d7a-81b2-e9824e0af831 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:12.180320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 479/979] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:07:11 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:12.181410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ce01e-0f82-4532-96d7-c7d8dedbf923 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:12.254872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:12.264053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae043ddc-a014-4d7a-81b2-e9824e0af831 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:12.331148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285fb1-b90d-4499-ad66-0e3535cab1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:12.331809 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285fb1-b90d-4499-ad66-0e3535cab1bd None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:12.332082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285fb1-b90d-4499-ad66-0e3535cab1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:12.332347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285fb1-b90d-4499-ad66-0e3535cab1bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:12.344372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8285fb1-b90d-4499-ad66-0e3535cab1bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:12.347429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8285fb1-b90d-4499-ad66-0e3535cab1bd None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:12.355872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ce01e-0f82-4532-96d7-c7d8dedbf923 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-a8285fb1-b90d-4499-ad66-0e3535cab1bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:07:12.361794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:12.362784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:12.363771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:12.363771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:12.363771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:07:12.363771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:07:12.363771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:07:12.363771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:07:12.363771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:07:12.363771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:07:12.363771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 05:07:12.363771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:12.365010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 501/980] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 4 05:07:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:12.372746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285fb1-b90d-4499-ad66-0e3535cab1bd None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:12.403481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff133bbd-675e-46a8-9a2a-4741b5a17c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:12.404353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff133bbd-675e-46a8-9a2a-4741b5a17c15 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:12.404733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff133bbd-675e-46a8-9a2a-4741b5a17c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:12.405161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff133bbd-675e-46a8-9a2a-4741b5a17c15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:12.413672 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff133bbd-675e-46a8-9a2a-4741b5a17c15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:12.415201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff133bbd-675e-46a8-9a2a-4741b5a17c15 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:12.430060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-ff133bbd-675e-46a8-9a2a-4741b5a17c15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:07:12.435294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:12.436535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:12.437668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:12.437668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:12.437668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:07:12.437668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:07:12.437668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:07:12.437668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:07:12.437668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:07:12.437668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:07:12.437668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 05:07:12.437668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:12.438971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 480/981] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:07:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:12.444666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff133bbd-675e-46a8-9a2a-4741b5a17c15 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:12.490121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285fb1-b90d-4499-ad66-0e3535cab1bd None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:12.527781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7f56b-e564-4a2d-a9f1-aa7a63d243d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:12.528719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7f56b-e564-4a2d-a9f1-aa7a63d243d0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:12.529136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7f56b-e564-4a2d-a9f1-aa7a63d243d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:12.529596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7f56b-e564-4a2d-a9f1-aa7a63d243d0 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:12.530390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7f56b-e564-4a2d-a9f1-aa7a63d243d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:12.530696 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7f56b-e564-4a2d-a9f1-aa7a63d243d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:12.532109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7f56b-e564-4a2d-a9f1-aa7a63d243d0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:12.555008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 502/982] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Aug 4 05:07:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:12.561274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7f56b-e564-4a2d-a9f1-aa7a63d243d0 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:12.572066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:12.576847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff133bbd-675e-46a8-9a2a-4741b5a17c15 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:12.620569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739e362-f5d1-4e33-bfbc-3b5caddafdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:12.622445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739e362-f5d1-4e33-bfbc-3b5caddafdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:12.623281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739e362-f5d1-4e33-bfbc-3b5caddafdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:12.624050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739e362-f5d1-4e33-bfbc-3b5caddafdf8 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:12.625199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739e362-f5d1-4e33-bfbc-3b5caddafdf8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:12.625716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739e362-f5d1-4e33-bfbc-3b5caddafdf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:12.627850 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739e362-f5d1-4e33-bfbc-3b5caddafdf8 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:12.682807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 481/983] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Aug 4 05:07:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:12.687971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7f56b-e564-4a2d-a9f1-aa7a63d243d0 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:12.697299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:12.729105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92ea08-9f6a-49f9-bbf8-b99dae6a8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:12.729725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92ea08-9f6a-49f9-bbf8-b99dae6a8851 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:12.730016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92ea08-9f6a-49f9-bbf8-b99dae6a8851 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:12.730368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92ea08-9f6a-49f9-bbf8-b99dae6a8851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:12.810503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92ea08-9f6a-49f9-bbf8-b99dae6a8851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:12.812060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92ea08-9f6a-49f9-bbf8-b99dae6a8851 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:12.930460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 503/984] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:12 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 05:07:12.936663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739e362-f5d1-4e33-bfbc-3b5caddafdf8 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:13.050240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739e362-f5d1-4e33-bfbc-3b5caddafdf8 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:13.085973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32012c-3823-4f3b-8265-a1e59346c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:13.086606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32012c-3823-4f3b-8265-a1e59346c937 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:13.086880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32012c-3823-4f3b-8265-a1e59346c937 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:13.087153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32012c-3823-4f3b-8265-a1e59346c937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:13.098345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32012c-3823-4f3b-8265-a1e59346c937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:13.099787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32012c-3823-4f3b-8265-a1e59346c937 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-6b32012c-3823-4f3b-8265-a1e59346c937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:13.114457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:13.115414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:13.121275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:13.121275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:13.121275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:13.121275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:13.121275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 482/985] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:13.123194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92ea08-9f6a-49f9-bbf8-b99dae6a8851 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:13.131837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:13.236912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92ea08-9f6a-49f9-bbf8-b99dae6a8851 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:13.271547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d65e9-cce9-4a3c-88cd-621ca53644b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:13.272158 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d65e9-cce9-4a3c-88cd-621ca53644b9 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:13.272434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d65e9-cce9-4a3c-88cd-621ca53644b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:13.272706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d65e9-cce9-4a3c-88cd-621ca53644b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:13.273393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d65e9-cce9-4a3c-88cd-621ca53644b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:13.273695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d65e9-cce9-4a3c-88cd-621ca53644b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:13.275059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d65e9-cce9-4a3c-88cd-621ca53644b9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:13.287630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 504/986] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:13.293321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32012c-3823-4f3b-8265-a1e59346c937 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:13.305008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:13.398898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32012c-3823-4f3b-8265-a1e59346c937 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:13.435524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37fb5-3623-4d7d-a75c-b2d7e5ad5d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:13.436166 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37fb5-3623-4d7d-a75c-b2d7e5ad5d40 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:13.436446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37fb5-3623-4d7d-a75c-b2d7e5ad5d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:13.436721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37fb5-3623-4d7d-a75c-b2d7e5ad5d40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:13.443594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37fb5-3623-4d7d-a75c-b2d7e5ad5d40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:13.445047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37fb5-3623-4d7d-a75c-b2d7e5ad5d40 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-c4e37fb5-3623-4d7d-a75c-b2d7e5ad5d40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:07:13.457804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:13.458836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:13.459736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:07:13.459736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:07:13.459736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:07:13.459736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:07:13.459736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:07:13.459736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:07:13.459736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:13.459736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:13.462386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 483/987] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:07:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:13.465152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d65e9-cce9-4a3c-88cd-621ca53644b9 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:13.535486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:13.571283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d65e9-cce9-4a3c-88cd-621ca53644b9 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:13.605475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bda279-593c-4507-9673-4281a6e4a2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:13.606293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bda279-593c-4507-9673-4281a6e4a2cd None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:13.606596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bda279-593c-4507-9673-4281a6e4a2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:13.606985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bda279-593c-4507-9673-4281a6e4a2cd None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:13.607672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bda279-593c-4507-9673-4281a6e4a2cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:13.607976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bda279-593c-4507-9673-4281a6e4a2cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:13.609446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bda279-593c-4507-9673-4281a6e4a2cd None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:13.627603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 505/988] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:07:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:13.629165 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37fb5-3623-4d7d-a75c-b2d7e5ad5d40 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:13.702491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:13.739305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37fb5-3623-4d7d-a75c-b2d7e5ad5d40 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:13.774935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80fe99-4de4-432f-9e3a-e0ac59858469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:13.775542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80fe99-4de4-432f-9e3a-e0ac59858469 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:13.775819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80fe99-4de4-432f-9e3a-e0ac59858469 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:13.776089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80fe99-4de4-432f-9e3a-e0ac59858469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:13.776899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80fe99-4de4-432f-9e3a-e0ac59858469 None admin] RBAC: Adding query filter params (role.id=343dc7bf754f4d9a9c48b8579b46f26c, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=c6bef167110b40519ff4e31456803b09) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:13.777206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80fe99-4de4-432f-9e3a-e0ac59858469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:13.778648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80fe99-4de4-432f-9e3a-e0ac59858469 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:13.784786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 484/989] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:07:13 2022] GET /identity/v3/role_assignments?user.id=c6bef167110b40519ff4e31456803b09&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=343dc7bf754f4d9a9c48b8579b46f26c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:13.848890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06c51-86f6-492e-b2df-c38882d88dfe None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:13.849072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06c51-86f6-492e-b2df-c38882d88dfe None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:13.849352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06c51-86f6-492e-b2df-c38882d88dfe None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:13.851003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 506/990] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:13.857623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624769fe-70ad-4c73-8766-8e6b40cc8d0f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:13.857913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624769fe-70ad-4c73-8766-8e6b40cc8d0f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:13.858385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624769fe-70ad-4c73-8766-8e6b40cc8d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:13.880036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-624769fe-70ad-4c73-8766-8e6b40cc8d0f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:13.881400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-624769fe-70ad-4c73-8766-8e6b40cc8d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:13.966685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 485/991] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:13.989525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d06c51-86f6-492e-b2df-c38882d88dfe None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:14.099738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d06c51-86f6-492e-b2df-c38882d88dfe None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:14.127022 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:14.136088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba0bc-1dc5-438b-8f35-83c992131846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:14.137384 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba0bc-1dc5-438b-8f35-83c992131846 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:14.137663 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba0bc-1dc5-438b-8f35-83c992131846 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:14.137908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba0bc-1dc5-438b-8f35-83c992131846 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:14.138565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eba0bc-1dc5-438b-8f35-83c992131846 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:14.139949 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eba0bc-1dc5-438b-8f35-83c992131846 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-c4eba0bc-1dc5-438b-8f35-83c992131846 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:14.149042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:14.156638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:14.157524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 507/992] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Aug 4 05:07:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:14.161993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624769fe-70ad-4c73-8766-8e6b40cc8d0f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:14.229085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:14.269463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624769fe-70ad-4c73-8766-8e6b40cc8d0f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:14.305613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd80c9-f69e-4e9c-ac51-387cdff8a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:14.306237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd80c9-f69e-4e9c-ac51-387cdff8a7dc None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:14.306542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd80c9-f69e-4e9c-ac51-387cdff8a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:14.306815 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd80c9-f69e-4e9c-ac51-387cdff8a7dc None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:14.307487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd80c9-f69e-4e9c-ac51-387cdff8a7dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:14.307789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd80c9-f69e-4e9c-ac51-387cdff8a7dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:14.309852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd80c9-f69e-4e9c-ac51-387cdff8a7dc None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:14.318347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 486/993] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Aug 4 05:07:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:14.321010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba0bc-1dc5-438b-8f35-83c992131846 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:14.351382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0030d-a88f-45bd-ac89-c17f5668201c None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:14.351683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0030d-a88f-45bd-ac89-c17f5668201c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:14.351859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0030d-a88f-45bd-ac89-c17f5668201c None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:14.353353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 487/994] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:07:14.358888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741b915-86bd-4be4-a589-8120ed080053 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:14.359170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741b915-86bd-4be4-a589-8120ed080053 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:14.359445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741b915-86bd-4be4-a589-8120ed080053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:14.378618 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-3741b915-86bd-4be4-a589-8120ed080053 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:14.379792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3741b915-86bd-4be4-a589-8120ed080053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:14.433053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba0bc-1dc5-438b-8f35-83c992131846 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:14.462458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 488/995] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:14.468357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c9730-f9a1-4729-8bfc-59750fe5c901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:14.468975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c9730-f9a1-4729-8bfc-59750fe5c901 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:14.469252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c9730-f9a1-4729-8bfc-59750fe5c901 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:14.469525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c9730-f9a1-4729-8bfc-59750fe5c901 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:14.470202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c9730-f9a1-4729-8bfc-59750fe5c901 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:14.470532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c9730-f9a1-4729-8bfc-59750fe5c901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:14.471881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c9730-f9a1-4729-8bfc-59750fe5c901 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:14.473886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741b915-86bd-4be4-a589-8120ed080053 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:14.482628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 508/996] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Aug 4 05:07:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:14.483335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c9730-f9a1-4729-8bfc-59750fe5c901 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:14.536983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:14.544702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:14.588682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741b915-86bd-4be4-a589-8120ed080053 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:14.594488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c9730-f9a1-4729-8bfc-59750fe5c901 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:14.635985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511e019-cbc5-41b0-a44c-23a7409d8acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:14.637168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511e019-cbc5-41b0-a44c-23a7409d8acc None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:14.637445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511e019-cbc5-41b0-a44c-23a7409d8acc None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:14.637807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511e019-cbc5-41b0-a44c-23a7409d8acc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:14.638460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf6693-2937-4b2f-ac2d-eaaccc729443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:14.638586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511e019-cbc5-41b0-a44c-23a7409d8acc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:14.639416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf6693-2937-4b2f-ac2d-eaaccc729443 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:14.639785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf6693-2937-4b2f-ac2d-eaaccc729443 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:14.639980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511e019-cbc5-41b0-a44c-23a7409d8acc None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:14.640216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf6693-2937-4b2f-ac2d-eaaccc729443 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:14.640989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf6693-2937-4b2f-ac2d-eaaccc729443 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:14.643076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf6693-2937-4b2f-ac2d-eaaccc729443 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-b511e019-cbc5-41b0-a44c-23a7409d8acc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:14.649079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:14.651031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:14.652992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 489/997] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:07:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:14.657190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511e019-cbc5-41b0-a44c-23a7409d8acc None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:14.758875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 509/998] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:07:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:14.763911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511e019-cbc5-41b0-a44c-23a7409d8acc None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:14.790675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:14.816710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03d38-ad6f-43fb-a363-35b5e0f33c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:14.817443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03d38-ad6f-43fb-a363-35b5e0f33c83 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:14.817790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03d38-ad6f-43fb-a363-35b5e0f33c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:14.818239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03d38-ad6f-43fb-a363-35b5e0f33c83 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:14.818994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df03d38-ad6f-43fb-a363-35b5e0f33c83 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:14.819369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df03d38-ad6f-43fb-a363-35b5e0f33c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:14.820860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df03d38-ad6f-43fb-a363-35b5e0f33c83 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:14.832203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 490/999] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:07:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:14.833784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf6693-2937-4b2f-ac2d-eaaccc729443 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:14.952119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf6693-2937-4b2f-ac2d-eaaccc729443 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:14.966843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:14.987067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bfb5d-ada4-4896-a8de-1b90d70f0e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:14.987686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bfb5d-ada4-4896-a8de-1b90d70f0e8b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:14.987956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bfb5d-ada4-4896-a8de-1b90d70f0e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:14.988234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bfb5d-ada4-4896-a8de-1b90d70f0e8b None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:14.988891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bfb5d-ada4-4896-a8de-1b90d70f0e8b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:14.989190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bfb5d-ada4-4896-a8de-1b90d70f0e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:14.990613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bfb5d-ada4-4896-a8de-1b90d70f0e8b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:14.996633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 510/1000] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:07:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:15.002225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03d38-ad6f-43fb-a363-35b5e0f33c83 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:15.110594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03d38-ad6f-43fb-a363-35b5e0f33c83 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:15.145566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26ad3b-aeb1-438d-83ac-a8251b93ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:15.146186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26ad3b-aeb1-438d-83ac-a8251b93ec26 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:15.146497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26ad3b-aeb1-438d-83ac-a8251b93ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:15.146776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26ad3b-aeb1-438d-83ac-a8251b93ec26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:15.147529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26ad3b-aeb1-438d-83ac-a8251b93ec26 None admin] RBAC: Adding query filter params (interface=public, service_id=28ea3be3d6134d798ee036353fa48a38, region_id=RegionOne) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:15.147840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26ad3b-aeb1-438d-83ac-a8251b93ec26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:15.149203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26ad3b-aeb1-438d-83ac-a8251b93ec26 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:15.159336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 491/1001] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 4 05:07:15 2022] GET /identity/v3/endpoints?service_id=28ea3be3d6134d798ee036353fa48a38&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:15.161377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bfb5d-ada4-4896-a8de-1b90d70f0e8b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:15.270296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bfb5d-ada4-4896-a8de-1b90d70f0e8b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:15.305282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c29d8-e317-49cd-9e94-2f395fefb1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:15.306039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c29d8-e317-49cd-9e94-2f395fefb1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:15.306441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c29d8-e317-49cd-9e94-2f395fefb1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:15.306817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c29d8-e317-49cd-9e94-2f395fefb1d3 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:15.307567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c29d8-e317-49cd-9e94-2f395fefb1d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:15.309761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c29d8-e317-49cd-9e94-2f395fefb1d3 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:15.316594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 511/1002] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 4 05:07:15 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:07:15.858726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad58a2-514a-4dc2-b372-ec91dfb56479 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:15.859066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad58a2-514a-4dc2-b372-ec91dfb56479 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:15.859293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad58a2-514a-4dc2-b372-ec91dfb56479 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:15.860766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 492/1003] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:15.865932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc881-b359-4486-9934-7cabeb87054d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:15.866219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc881-b359-4486-9934-7cabeb87054d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:15.866522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc881-b359-4486-9934-7cabeb87054d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:15.884964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-059dc881-b359-4486-9934-7cabeb87054d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:15.886519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-059dc881-b359-4486-9934-7cabeb87054d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:15.926357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:15.959831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 512/1004] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:15 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:15.983652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad58a2-514a-4dc2-b372-ec91dfb56479 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:16.034725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:16.092867 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad58a2-514a-4dc2-b372-ec91dfb56479 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:16.126104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c41d9d-47c8-4f03-a41a-08c84fe93346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:16.126775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c41d9d-47c8-4f03-a41a-08c84fe93346 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:16.127050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c41d9d-47c8-4f03-a41a-08c84fe93346 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:16.127310 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c41d9d-47c8-4f03-a41a-08c84fe93346 None admin] PATH_INFO: `/v3/services/image` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:16.127932 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c41d9d-47c8-4f03-a41a-08c84fe93346 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:16.129287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c41d9d-47c8-4f03-a41a-08c84fe93346 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-c7c41d9d-47c8-4f03-a41a-08c84fe93346 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:16.138755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:16.139772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:16.140621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 493/1005] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Aug 4 05:07:15 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:16.147841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dc881-b359-4486-9934-7cabeb87054d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:16.259576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dc881-b359-4486-9934-7cabeb87054d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:16.294659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396435a-9601-4773-add8-4d34bbc8169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:16.295274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396435a-9601-4773-add8-4d34bbc8169e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:16.295548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396435a-9601-4773-add8-4d34bbc8169e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:16.295813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396435a-9601-4773-add8-4d34bbc8169e None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:16.296477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396435a-9601-4773-add8-4d34bbc8169e None admin] RBAC: Adding query filter params (name=image) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:16.296773 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396435a-9601-4773-add8-4d34bbc8169e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:16.298561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396435a-9601-4773-add8-4d34bbc8169e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:16.308335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 513/1006] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:16.309595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c41d9d-47c8-4f03-a41a-08c84fe93346 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:16.413778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c41d9d-47c8-4f03-a41a-08c84fe93346 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:16.423541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:16.451278 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc926c1-b72a-4e78-83a8-afe6a527472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:16.451913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc926c1-b72a-4e78-83a8-afe6a527472e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:16.452196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc926c1-b72a-4e78-83a8-afe6a527472e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:16.452463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc926c1-b72a-4e78-83a8-afe6a527472e None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:16.453156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc926c1-b72a-4e78-83a8-afe6a527472e None admin] RBAC: Adding query filter params (type=image) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:16.453488 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc926c1-b72a-4e78-83a8-afe6a527472e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:16.454902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc926c1-b72a-4e78-83a8-afe6a527472e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:16.466344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 494/1007] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:16.832665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d3f0f-51a3-4a8a-87a8-a0253a2e3d44 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:16.832839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d3f0f-51a3-4a8a-87a8-a0253a2e3d44 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:16.833109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d3f0f-51a3-4a8a-87a8-a0253a2e3d44 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:16.834626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 514/1008] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:16.839775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b661e-567a-41f4-8e0e-dc1ef7e75661 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:16.840055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b661e-567a-41f4-8e0e-dc1ef7e75661 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:16.840336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b661e-567a-41f4-8e0e-dc1ef7e75661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:16.858907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d00b661e-567a-41f4-8e0e-dc1ef7e75661 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:16.860137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d00b661e-567a-41f4-8e0e-dc1ef7e75661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:16.931965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 495/1009] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:16 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:16.955292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d3f0f-51a3-4a8a-87a8-a0253a2e3d44 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:16.992464 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:17.060589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d3f0f-51a3-4a8a-87a8-a0253a2e3d44 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:17.097479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50340c2e-7aba-4a51-94c7-cf561a7fe9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:17.098029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50340c2e-7aba-4a51-94c7-cf561a7fe9aa None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:17.098320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50340c2e-7aba-4a51-94c7-cf561a7fe9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:17.098610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50340c2e-7aba-4a51-94c7-cf561a7fe9aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:17.099759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50340c2e-7aba-4a51-94c7-cf561a7fe9aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:17.101194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50340c2e-7aba-4a51-94c7-cf561a7fe9aa None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:17.107818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 515/1010] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:17.108924 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b661e-567a-41f4-8e0e-dc1ef7e75661 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:17.223288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b661e-567a-41f4-8e0e-dc1ef7e75661 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:17.224974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:17.258662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e024d6-ec10-4aee-b6f2-814e651f89cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:17.259309 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e024d6-ec10-4aee-b6f2-814e651f89cf None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:17.259590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e024d6-ec10-4aee-b6f2-814e651f89cf None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:17.259863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e024d6-ec10-4aee-b6f2-814e651f89cf None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:17.260552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e024d6-ec10-4aee-b6f2-814e651f89cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:17.262573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e024d6-ec10-4aee-b6f2-814e651f89cf None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:17.362425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 496/1011] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:07:17 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:17.373531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3a25b-933d-42da-9618-bf9dad900f25 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:17.374064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3a25b-933d-42da-9618-bf9dad900f25 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:17.374064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3a25b-933d-42da-9618-bf9dad900f25 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:17.375495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 516/1012] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:07:17.381478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc963c-9a01-4f66-bebc-ebfacc67b33d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:17.381832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc963c-9a01-4f66-bebc-ebfacc67b33d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:17.382012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc963c-9a01-4f66-bebc-ebfacc67b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:17.403342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-dccc963c-9a01-4f66-bebc-ebfacc67b33d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:17.404546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-dccc963c-9a01-4f66-bebc-ebfacc67b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:17.483887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 497/1013] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:17.507655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3a25b-933d-42da-9618-bf9dad900f25 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:17.623764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3a25b-933d-42da-9618-bf9dad900f25 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:17.626104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:17.660444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f67f5-a11a-4562-9673-3cd3f2191bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:17.661086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f67f5-a11a-4562-9673-3cd3f2191bae None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:17.661358 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f67f5-a11a-4562-9673-3cd3f2191bae None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:17.661623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f67f5-a11a-4562-9673-3cd3f2191bae None admin] PATH_INFO: `/v3/services/compute` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:17.662240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f67f5-a11a-4562-9673-3cd3f2191bae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:17.663638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f67f5-a11a-4562-9673-3cd3f2191bae None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-6f2f67f5-a11a-4562-9673-3cd3f2191bae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:17.673240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:17.674251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:17.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 517/1014] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:07:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:17.680880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc963c-9a01-4f66-bebc-ebfacc67b33d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:17.775923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:17.792510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc963c-9a01-4f66-bebc-ebfacc67b33d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:17.827103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77399264-6911-4b99-85b9-d3930f43e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:17.827723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399264-6911-4b99-85b9-d3930f43e669 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:17.828001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399264-6911-4b99-85b9-d3930f43e669 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:17.828275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399264-6911-4b99-85b9-d3930f43e669 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:17.828953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77399264-6911-4b99-85b9-d3930f43e669 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:17.829256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77399264-6911-4b99-85b9-d3930f43e669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:17.830688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77399264-6911-4b99-85b9-d3930f43e669 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:17.840986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 498/1015] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:07:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:17.842770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f67f5-a11a-4562-9673-3cd3f2191bae None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:17.952317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f67f5-a11a-4562-9673-3cd3f2191bae None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:17.987107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bc2b6-ee5e-453b-bf0c-042f859d12de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:17.987719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bc2b6-ee5e-453b-bf0c-042f859d12de None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:17.987995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bc2b6-ee5e-453b-bf0c-042f859d12de None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:17.988267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bc2b6-ee5e-453b-bf0c-042f859d12de None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:17.988937 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bc2b6-ee5e-453b-bf0c-042f859d12de None admin] RBAC: Adding query filter params (type=compute) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:17.989239 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bc2b6-ee5e-453b-bf0c-042f859d12de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:17.990798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bc2b6-ee5e-453b-bf0c-042f859d12de None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:18.000455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 518/1016] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Aug 4 05:07:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:18.002005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77399264-6911-4b99-85b9-d3930f43e669 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:18.105840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77399264-6911-4b99-85b9-d3930f43e669 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:18.142425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad293471-199b-416d-9e9a-fcd00e1c4fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:18.143072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad293471-199b-416d-9e9a-fcd00e1c4fe2 None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:18.143329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad293471-199b-416d-9e9a-fcd00e1c4fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:18.143579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad293471-199b-416d-9e9a-fcd00e1c4fe2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:18.144282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad293471-199b-416d-9e9a-fcd00e1c4fe2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:18.145734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad293471-199b-416d-9e9a-fcd00e1c4fe2 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:18.248772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 499/1017] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:07:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:18.499305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1fe38-0ded-471d-ae9a-1edcf1634d95 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:18.499815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1fe38-0ded-471d-ae9a-1edcf1634d95 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:18.499815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1fe38-0ded-471d-ae9a-1edcf1634d95 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:18.501131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 519/1018] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:18.506818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2da135-3005-4fc5-b2c5-682efda3e202 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:18.507167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2da135-3005-4fc5-b2c5-682efda3e202 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:18.507453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2da135-3005-4fc5-b2c5-682efda3e202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:18.516133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:18.528853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-cb2da135-3005-4fc5-b2c5-682efda3e202 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:18.530052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cb2da135-3005-4fc5-b2c5-682efda3e202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:18.611584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 500/1019] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:18 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:18.634604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1fe38-0ded-471d-ae9a-1edcf1634d95 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:18.667160 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:18.743170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1fe38-0ded-471d-ae9a-1edcf1634d95 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:18.781258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13f918-ee13-4554-8c2f-3e629f56072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:18.781830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13f918-ee13-4554-8c2f-3e629f56072c None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:18.782161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13f918-ee13-4554-8c2f-3e629f56072c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:18.782468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13f918-ee13-4554-8c2f-3e629f56072c None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:18.783161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13f918-ee13-4554-8c2f-3e629f56072c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:18.784680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13f918-ee13-4554-8c2f-3e629f56072c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:18.890331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 520/1020] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:07:18 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:19.455050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e74cf-c902-486d-9094-8d23e4c06a7a None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:19.455564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e74cf-c902-486d-9094-8d23e4c06a7a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:19.455564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e74cf-c902-486d-9094-8d23e4c06a7a None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:19.456844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 501/1021] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:19.462205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a85b26-07b8-4f27-b0e2-2bb02d55372b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:19.462526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a85b26-07b8-4f27-b0e2-2bb02d55372b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:19.462814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a85b26-07b8-4f27-b0e2-2bb02d55372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:19.482178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c9a85b26-07b8-4f27-b0e2-2bb02d55372b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:19.483424 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c9a85b26-07b8-4f27-b0e2-2bb02d55372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:19.559092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 521/1022] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:19.582954 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e74cf-c902-486d-9094-8d23e4c06a7a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:19.692519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e74cf-c902-486d-9094-8d23e4c06a7a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:19.727211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:19.728308 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc2a6b-4837-47f6-b4c4-567d40be86a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:19.728939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc2a6b-4837-47f6-b4c4-567d40be86a8 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:19.729224 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc2a6b-4837-47f6-b4c4-567d40be86a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:19.729489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc2a6b-4837-47f6-b4c4-567d40be86a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:19.731399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc2a6b-4837-47f6-b4c4-567d40be86a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:19.732953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc2a6b-4837-47f6-b4c4-567d40be86a8 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:19.739738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 502/1023] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:19.740638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a85b26-07b8-4f27-b0e2-2bb02d55372b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:19.760428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:19.842989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a85b26-07b8-4f27-b0e2-2bb02d55372b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:19.877944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52256-97fb-4d5c-9114-abba812af645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:19.878586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52256-97fb-4d5c-9114-abba812af645 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:19.878863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52256-97fb-4d5c-9114-abba812af645 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:19.879214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52256-97fb-4d5c-9114-abba812af645 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:19.879947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d52256-97fb-4d5c-9114-abba812af645 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:19.881355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d52256-97fb-4d5c-9114-abba812af645 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:20.015750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 522/1024] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:07:19 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:07:20.421368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b80577-8bc0-4703-9ea5-e97c27189efc None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:20.421773 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b80577-8bc0-4703-9ea5-e97c27189efc None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:20.422221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b80577-8bc0-4703-9ea5-e97c27189efc None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:20.423722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 503/1025] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:20.428938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddde77-ad28-49ee-b336-5de650652af7 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:20.429234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddde77-ad28-49ee-b336-5de650652af7 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:20.429511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddde77-ad28-49ee-b336-5de650652af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:20.449925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c9ddde77-ad28-49ee-b336-5de650652af7 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:20.451144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c9ddde77-ad28-49ee-b336-5de650652af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:20.522349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 523/1026] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:20.544489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b80577-8bc0-4703-9ea5-e97c27189efc None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:20.649870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b80577-8bc0-4703-9ea5-e97c27189efc None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:20.684825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc29ac5-2f0f-4671-b2b5-d801e36cc0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:20.685381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc29ac5-2f0f-4671-b2b5-d801e36cc0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:20.685656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc29ac5-2f0f-4671-b2b5-d801e36cc0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:20.685928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc29ac5-2f0f-4671-b2b5-d801e36cc0f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:20.696256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc29ac5-2f0f-4671-b2b5-d801e36cc0f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-1dc29ac5-2f0f-4671-b2b5-d801e36cc0f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:20.701526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:20.702585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:20.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:20.706681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 504/1027] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Aug 4 05:07:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:20.708785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddde77-ad28-49ee-b336-5de650652af7 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:20.712604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:20.811266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddde77-ad28-49ee-b336-5de650652af7 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:20.845360 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf3ce-5ed3-43b7-b95d-a241b773861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:20.845967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf3ce-5ed3-43b7-b95d-a241b773861e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:20.846317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf3ce-5ed3-43b7-b95d-a241b773861e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:20.846593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf3ce-5ed3-43b7-b95d-a241b773861e None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:20.847298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf3ce-5ed3-43b7-b95d-a241b773861e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:20.847588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf3ce-5ed3-43b7-b95d-a241b773861e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:20.848920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf3ce-5ed3-43b7-b95d-a241b773861e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:20.857936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 524/1028] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Aug 4 05:07:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:20.863385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc29ac5-2f0f-4671-b2b5-d801e36cc0f0 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:20.926356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:20.954665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f328d-ad13-4147-a56d-dfb49fa9e82c None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:20.954943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f328d-ad13-4147-a56d-dfb49fa9e82c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:20.955120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f328d-ad13-4147-a56d-dfb49fa9e82c None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:20.956742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 525/1029] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:20.961777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59bb50-a800-45ef-8a48-08047f0c6ebd None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:20.962061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59bb50-a800-45ef-8a48-08047f0c6ebd None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:20.962349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59bb50-a800-45ef-8a48-08047f0c6ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:20.969295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc29ac5-2f0f-4671-b2b5-d801e36cc0f0 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:20.982546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-fc59bb50-a800-45ef-8a48-08047f0c6ebd None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:20.983740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-fc59bb50-a800-45ef-8a48-08047f0c6ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:21.006445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357737f-b218-449f-9f1d-9303fa2cf354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:21.007088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357737f-b218-449f-9f1d-9303fa2cf354 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:21.007351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357737f-b218-449f-9f1d-9303fa2cf354 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:21.007616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357737f-b218-449f-9f1d-9303fa2cf354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:21.018425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357737f-b218-449f-9f1d-9303fa2cf354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:21.019862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357737f-b218-449f-9f1d-9303fa2cf354 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-8357737f-b218-449f-9f1d-9303fa2cf354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:21.034651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:21.035613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:21.037219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:21.037219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:21.037219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:21.037219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:21.037219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 505/1030] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:21.041376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357737f-b218-449f-9f1d-9303fa2cf354 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:21.053373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:21.066382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 526/1031] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:21.085898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59bb50-a800-45ef-8a48-08047f0c6ebd None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:21.150043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357737f-b218-449f-9f1d-9303fa2cf354 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:21.165469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:21.193307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0672c-94d1-4741-9170-2de0db170298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:21.194212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0672c-94d1-4741-9170-2de0db170298 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:21.194724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0672c-94d1-4741-9170-2de0db170298 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:21.195273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0672c-94d1-4741-9170-2de0db170298 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:21.196040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0672c-94d1-4741-9170-2de0db170298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:21.196346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0672c-94d1-4741-9170-2de0db170298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:21.197863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0672c-94d1-4741-9170-2de0db170298 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:21.202094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59bb50-a800-45ef-8a48-08047f0c6ebd None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:21.217648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 506/1032] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:21.218939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0672c-94d1-4741-9170-2de0db170298 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:21.241126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9d3f6-aa42-4222-91e2-5d86f9745dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:21.241766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d3f6-aa42-4222-91e2-5d86f9745dfb None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:21.242048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d3f6-aa42-4222-91e2-5d86f9745dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:21.242300 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d3f6-aa42-4222-91e2-5d86f9745dfb None admin] PATH_INFO: `/v3/services/image` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:21.242943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9d3f6-aa42-4222-91e2-5d86f9745dfb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:21.244281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9d3f6-aa42-4222-91e2-5d86f9745dfb None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-daf9d3f6-aa42-4222-91e2-5d86f9745dfb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:21.253564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:21.255056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 05:07:21.256225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:21.260015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 527/1033] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Aug 4 05:07:21 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:21.260739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9d3f6-aa42-4222-91e2-5d86f9745dfb None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:21.323638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:21.336470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0672c-94d1-4741-9170-2de0db170298 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:21.369444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9d3f6-aa42-4222-91e2-5d86f9745dfb None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:21.373910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a51a1-7e87-4a9e-b605-2365c9d3c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:21.374567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a51a1-7e87-4a9e-b605-2365c9d3c556 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:21.374844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a51a1-7e87-4a9e-b605-2365c9d3c556 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:21.375110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a51a1-7e87-4a9e-b605-2365c9d3c556 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:21.382300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a51a1-7e87-4a9e-b605-2365c9d3c556 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:21.384684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a51a1-7e87-4a9e-b605-2365c9d3c556 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-dc7a51a1-7e87-4a9e-b605-2365c9d3c556 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:07:21.396188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:21.397179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:21.398161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 507/1034] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 4 05:07:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:21.403202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a51a1-7e87-4a9e-b605-2365c9d3c556 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:21.417090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb175d-0117-4cf0-aa11-b31249bc4864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:21.418430 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb175d-0117-4cf0-aa11-b31249bc4864 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:21.419006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb175d-0117-4cf0-aa11-b31249bc4864 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:21.419371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb175d-0117-4cf0-aa11-b31249bc4864 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:21.420110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb175d-0117-4cf0-aa11-b31249bc4864 None admin] RBAC: Adding query filter params (name=image) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:21.420479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb175d-0117-4cf0-aa11-b31249bc4864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:21.422174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb175d-0117-4cf0-aa11-b31249bc4864 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:21.427397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 528/1035] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:21.433111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb175d-0117-4cf0-aa11-b31249bc4864 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:21.443226 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:21.522191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a51a1-7e87-4a9e-b605-2365c9d3c556 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:21.538919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb175d-0117-4cf0-aa11-b31249bc4864 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:21.559935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccfb5a-3cbe-4a25-9140-25088c79d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:21.560509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccfb5a-3cbe-4a25-9140-25088c79d3bf None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:21.560680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccfb5a-3cbe-4a25-9140-25088c79d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:21.560997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccfb5a-3cbe-4a25-9140-25088c79d3bf None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:21.561756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccfb5a-3cbe-4a25-9140-25088c79d3bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:21.562076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccfb5a-3cbe-4a25-9140-25088c79d3bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:21.563377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:21.563496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccfb5a-3cbe-4a25-9140-25088c79d3bf None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:21.575608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ea0c-a95a-47d7-a047-30fc1186a846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:21.578499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ea0c-a95a-47d7-a047-30fc1186a846 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:21.578499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ea0c-a95a-47d7-a047-30fc1186a846 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:21.578499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ea0c-a95a-47d7-a047-30fc1186a846 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:21.578499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669ea0c-a95a-47d7-a047-30fc1186a846 None admin] RBAC: Adding query filter params (type=image) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:21.578499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669ea0c-a95a-47d7-a047-30fc1186a846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:21.579110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669ea0c-a95a-47d7-a047-30fc1186a846 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:21.589919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 529/1036] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:21.590103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 508/1037] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 4 05:07:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:21.591621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ea0c-a95a-47d7-a047-30fc1186a846 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:21.592862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccfb5a-3cbe-4a25-9140-25088c79d3bf None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:21.688293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:21.701160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccfb5a-3cbe-4a25-9140-25088c79d3bf None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:21.706369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ea0c-a95a-47d7-a047-30fc1186a846 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:21.741307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227866d-15b6-4f1b-90a5-d1e491387b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:21.741949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce4f1c-c1d2-4f22-a81b-9856b862db16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:21.742083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227866d-15b6-4f1b-90a5-d1e491387b42 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:21.742163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227866d-15b6-4f1b-90a5-d1e491387b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:21.742443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4f1c-c1d2-4f22-a81b-9856b862db16 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:21.742562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227866d-15b6-4f1b-90a5-d1e491387b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:21.742675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4f1c-c1d2-4f22-a81b-9856b862db16 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:21.742961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4f1c-c1d2-4f22-a81b-9856b862db16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:21.743674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce4f1c-c1d2-4f22-a81b-9856b862db16 None admin] RBAC: Adding query filter params (interface=public, service_id=afccd08f40b34520bf7cb8316f992c0c, region_id=RegionOne) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:21.743974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce4f1c-c1d2-4f22-a81b-9856b862db16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:21.745333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce4f1c-c1d2-4f22-a81b-9856b862db16 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:21.759744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 509/1038] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 4 05:07:21 2022] GET /identity/v3/endpoints?service_id=afccd08f40b34520bf7cb8316f992c0c&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:21.760911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce4f1c-c1d2-4f22-a81b-9856b862db16 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:21.816958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:21.828879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227866d-15b6-4f1b-90a5-d1e491387b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:21.830335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227866d-15b6-4f1b-90a5-d1e491387b42 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:21.869937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce4f1c-c1d2-4f22-a81b-9856b862db16 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:21.906431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b047df3-917b-4f94-8aac-86258937ff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:21.907055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047df3-917b-4f94-8aac-86258937ff7a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:21.907335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047df3-917b-4f94-8aac-86258937ff7a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:21.907610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047df3-917b-4f94-8aac-86258937ff7a None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:21.908258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b047df3-917b-4f94-8aac-86258937ff7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:21.909677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b047df3-917b-4f94-8aac-86258937ff7a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:21.916600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 510/1039] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 4 05:07:21 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:07:21.939314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 530/1040] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:21 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 05:07:21.945137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b047df3-917b-4f94-8aac-86258937ff7a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:21.967138 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:22.064025 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b047df3-917b-4f94-8aac-86258937ff7a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:22.102465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35ccae-736d-4a3c-a054-728c6082b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:22.103032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35ccae-736d-4a3c-a054-728c6082b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.103310 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35ccae-736d-4a3c-a054-728c6082b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.103583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35ccae-736d-4a3c-a054-728c6082b5f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:22.114282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35ccae-736d-4a3c-a054-728c6082b5f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:22.115777 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35ccae-736d-4a3c-a054-728c6082b5f3 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:22.119091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6e577-c4cd-4fda-8e2d-f026a73f775c None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.119374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6e577-c4cd-4fda-8e2d-f026a73f775c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.119645 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6e577-c4cd-4fda-8e2d-f026a73f775c None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:22.121311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 531/1041] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:07:22.126387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ffb82-75cb-4401-9e87-99cfd58a0198 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.126671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ffb82-75cb-4401-9e87-99cfd58a0198 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.126975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ffb82-75cb-4401-9e87-99cfd58a0198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-9f35ccae-736d-4a3c-a054-728c6082b5f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:22.131528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:22.132417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:22.133808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:22.133808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:22.133808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:22.133808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:22.133808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 511/1042] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:22.139378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35ccae-736d-4a3c-a054-728c6082b5f3 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:22.147174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-263ffb82-75cb-4401-9e87-99cfd58a0198 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:22.148416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-263ffb82-75cb-4401-9e87-99cfd58a0198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:22.215958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:22.231107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 532/1043] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:22.250622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35ccae-736d-4a3c-a054-728c6082b5f3 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:22.255091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ffb82-75cb-4401-9e87-99cfd58a0198 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:22.277638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:22.291237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112b7d4-2887-44cc-b15e-3f90e9fa03bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:22.291861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112b7d4-2887-44cc-b15e-3f90e9fa03bb None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.292144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112b7d4-2887-44cc-b15e-3f90e9fa03bb None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.292483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112b7d4-2887-44cc-b15e-3f90e9fa03bb None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:22.293164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112b7d4-2887-44cc-b15e-3f90e9fa03bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:22.293470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112b7d4-2887-44cc-b15e-3f90e9fa03bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:22.294889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112b7d4-2887-44cc-b15e-3f90e9fa03bb None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:22.312878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 512/1044] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:22.314273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112b7d4-2887-44cc-b15e-3f90e9fa03bb None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:22.364677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ffb82-75cb-4401-9e87-99cfd58a0198 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:22.406641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ba793-af2d-490d-ba3c-82f178e0c64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:22.407288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ba793-af2d-490d-ba3c-82f178e0c64a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.407562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ba793-af2d-490d-ba3c-82f178e0c64a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.407831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ba793-af2d-490d-ba3c-82f178e0c64a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:22.418715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ba793-af2d-490d-ba3c-82f178e0c64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:22.422078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112b7d4-2887-44cc-b15e-3f90e9fa03bb None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3b4ba793-af2d-490d-ba3c-82f178e0c64a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:22.426804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:22.427999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:22.429132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 533/1045] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:07:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:22.431367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ba793-af2d-490d-ba3c-82f178e0c64a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:22.457570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:22.466008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da2deb-433c-438a-afb1-377a822a64de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:22.466827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da2deb-433c-438a-afb1-377a822a64de None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.467104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da2deb-433c-438a-afb1-377a822a64de None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.467693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da2deb-433c-438a-afb1-377a822a64de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:22.474521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da2deb-433c-438a-afb1-377a822a64de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:22.475963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da2deb-433c-438a-afb1-377a822a64de None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-e4da2deb-433c-438a-afb1-377a822a64de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:07:22.487732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:22.488673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:22.490357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:07:22.490357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:07:22.490357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:07:22.490357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:07:22.490357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:07:22.490357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:07:22.490357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:22.490357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:22.490357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 513/1046] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:22.494509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da2deb-433c-438a-afb1-377a822a64de None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:22.521958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:22.542825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ba793-af2d-490d-ba3c-82f178e0c64a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:22.578539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8a64b-b837-4e7e-a7b1-b59b7cfabc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:22.579174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8a64b-b837-4e7e-a7b1-b59b7cfabc88 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.579665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8a64b-b837-4e7e-a7b1-b59b7cfabc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.580068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8a64b-b837-4e7e-a7b1-b59b7cfabc88 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:22.581159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8a64b-b837-4e7e-a7b1-b59b7cfabc88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:22.581466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8a64b-b837-4e7e-a7b1-b59b7cfabc88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:22.582850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8a64b-b837-4e7e-a7b1-b59b7cfabc88 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:22.593122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 534/1047] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:07:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:22.598810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8a64b-b837-4e7e-a7b1-b59b7cfabc88 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:22.610398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da2deb-433c-438a-afb1-377a822a64de None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:22.645337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0819b-b54d-4c8e-81fb-091e44354bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:22.645959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0819b-b54d-4c8e-81fb-091e44354bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.646230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0819b-b54d-4c8e-81fb-091e44354bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.646598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0819b-b54d-4c8e-81fb-091e44354bd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:22.647276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0819b-b54d-4c8e-81fb-091e44354bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:22.647631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0819b-b54d-4c8e-81fb-091e44354bd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:22.649060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0819b-b54d-4c8e-81fb-091e44354bd7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:22.667148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 514/1048] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:22.669770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0819b-b54d-4c8e-81fb-091e44354bd7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:22.713950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8a64b-b837-4e7e-a7b1-b59b7cfabc88 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:22.722826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:22.752988 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95c1f5-8d1d-4d78-b463-fcfa13e074c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:22.756146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95c1f5-8d1d-4d78-b463-fcfa13e074c6 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.756146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95c1f5-8d1d-4d78-b463-fcfa13e074c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.756146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95c1f5-8d1d-4d78-b463-fcfa13e074c6 None admin] PATH_INFO: `/v3/users/0e794b20b7084392a03e1d0d839668c7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:22.765830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:22.769282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95c1f5-8d1d-4d78-b463-fcfa13e074c6 None admin] RBAC: Authorizing `identity:get_user(user_id=0e794b20b7084392a03e1d0d839668c7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:22.770736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95c1f5-8d1d-4d78-b463-fcfa13e074c6 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:22.774374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 535/1049] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:22 2022] GET /identity/v3/users/0e794b20b7084392a03e1d0d839668c7 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:22.778963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95c1f5-8d1d-4d78-b463-fcfa13e074c6 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:22.780607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0819b-b54d-4c8e-81fb-091e44354bd7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:22.817365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8636ad-0fb8-4617-b799-ab02f925b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:22.818214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8636ad-0fb8-4617-b799-ab02f925b26f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.818691 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8636ad-0fb8-4617-b799-ab02f925b26f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.819131 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8636ad-0fb8-4617-b799-ab02f925b26f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:22.820071 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8636ad-0fb8-4617-b799-ab02f925b26f None admin] RBAC: Adding query filter params (role.id=343dc7bf754f4d9a9c48b8579b46f26c, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=27f7331502484928ba7f8a4b403bdddd) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:22.820900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8636ad-0fb8-4617-b799-ab02f925b26f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:22.823073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8636ad-0fb8-4617-b799-ab02f925b26f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:22.831604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 515/1050] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:07:22 2022] GET /identity/v3/role_assignments?user.id=27f7331502484928ba7f8a4b403bdddd&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=343dc7bf754f4d9a9c48b8579b46f26c => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:22.896694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95c1f5-8d1d-4d78-b463-fcfa13e074c6 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:22.935094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d34a05-95b8-475b-88aa-d782c119d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:22.935719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34a05-95b8-475b-88aa-d782c119d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:22.935993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34a05-95b8-475b-88aa-d782c119d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:22.936260 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34a05-95b8-475b-88aa-d782c119d2a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:23.006238 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:23.010355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d34a05-95b8-475b-88aa-d782c119d2a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:23.012325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d34a05-95b8-475b-88aa-d782c119d2a9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:23.118472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 536/1051] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:22 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 05:07:23.124993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8636ad-0fb8-4617-b799-ab02f925b26f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:23.235796 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8636ad-0fb8-4617-b799-ab02f925b26f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:23.249651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:23.271677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a495ddd-228c-4832-8f8f-0fadf3d3298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:23.272322 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a495ddd-228c-4832-8f8f-0fadf3d3298a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:23.272597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a495ddd-228c-4832-8f8f-0fadf3d3298a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:23.272867 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a495ddd-228c-4832-8f8f-0fadf3d3298a None admin] PATH_INFO: `/v3/projects/3b30f4b17edb4e52b209acb4ca61d772` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:23.274134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a495ddd-228c-4832-8f8f-0fadf3d3298a None admin] RBAC: Authorizing `identity:get_project(project_id=3b30f4b17edb4e52b209acb4ca61d772)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:23.277307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a495ddd-228c-4832-8f8f-0fadf3d3298a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:23.282393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 516/1052] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:07:23 2022] GET /identity/v3/projects/3b30f4b17edb4e52b209acb4ca61d772 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:23.283952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d34a05-95b8-475b-88aa-d782c119d2a9 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:23.385033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:23.390269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d34a05-95b8-475b-88aa-d782c119d2a9 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:23.425541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b56a9-d46e-4fff-a7ff-6e90b769088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:23.426076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b56a9-d46e-4fff-a7ff-6e90b769088b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:23.426430 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b56a9-d46e-4fff-a7ff-6e90b769088b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:23.426706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b56a9-d46e-4fff-a7ff-6e90b769088b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:23.427573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b56a9-d46e-4fff-a7ff-6e90b769088b None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=3b30f4b17edb4e52b209acb4ca61d772, user.id=0e794b20b7084392a03e1d0d839668c7) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:23.427883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b56a9-d46e-4fff-a7ff-6e90b769088b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:23.429417 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b56a9-d46e-4fff-a7ff-6e90b769088b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:23.442355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 537/1053] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:07:23 2022] GET /identity/v3/role_assignments?user.id=0e794b20b7084392a03e1d0d839668c7&scope.project.id=3b30f4b17edb4e52b209acb4ca61d772&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:23.990858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2171b3-cb04-4004-885b-22aebba4e570 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:23.991446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2171b3-cb04-4004-885b-22aebba4e570 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:23.991446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2171b3-cb04-4004-885b-22aebba4e570 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:23.992917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 517/1054] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:23.998668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85e433-2919-44b9-a930-d251133bb3e3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:23.999085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85e433-2919-44b9-a930-d251133bb3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:23.999255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85e433-2919-44b9-a930-d251133bb3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:24.018008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-5f85e433-2919-44b9-a930-d251133bb3e3 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:24.019226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5f85e433-2919-44b9-a930-d251133bb3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:24.088947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 538/1055] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:24.111528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2171b3-cb04-4004-885b-22aebba4e570 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:24.224795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2171b3-cb04-4004-885b-22aebba4e570 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:24.261887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4140-1f51-4ec5-8820-20c6f7032e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:24.263141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4140-1f51-4ec5-8820-20c6f7032e61 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:24.263428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4140-1f51-4ec5-8820-20c6f7032e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:24.263707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4140-1f51-4ec5-8820-20c6f7032e61 None admin] PATH_INFO: `/v3/services/image` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:24.264371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4140-1f51-4ec5-8820-20c6f7032e61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:24.265775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4140-1f51-4ec5-8820-20c6f7032e61 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-749b4140-1f51-4ec5-8820-20c6f7032e61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:24.275076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:24.276127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 05:07:24.277787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:24.280318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 518/1056] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Aug 4 05:07:24 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:24.286967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85e433-2919-44b9-a930-d251133bb3e3 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:24.384168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:24.394772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85e433-2919-44b9-a930-d251133bb3e3 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:24.430885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9fb80-70f7-4230-9de0-86bf1aeb26d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:24.431498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9fb80-70f7-4230-9de0-86bf1aeb26d3 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:24.431776 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9fb80-70f7-4230-9de0-86bf1aeb26d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:24.432049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9fb80-70f7-4230-9de0-86bf1aeb26d3 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:24.432722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9fb80-70f7-4230-9de0-86bf1aeb26d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:24.433082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9fb80-70f7-4230-9de0-86bf1aeb26d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:24.434532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9fb80-70f7-4230-9de0-86bf1aeb26d3 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:24.444591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 539/1057] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:24.445874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4140-1f51-4ec5-8820-20c6f7032e61 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:24.496901 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:24.557004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4140-1f51-4ec5-8820-20c6f7032e61 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:24.595019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c7285-f1df-46ad-88bf-5210cd527dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:24.595639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c7285-f1df-46ad-88bf-5210cd527dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:24.595917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c7285-f1df-46ad-88bf-5210cd527dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:24.596195 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c7285-f1df-46ad-88bf-5210cd527dc5 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:24.596870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c7285-f1df-46ad-88bf-5210cd527dc5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:24.597176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c7285-f1df-46ad-88bf-5210cd527dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:24.598571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c7285-f1df-46ad-88bf-5210cd527dc5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:24.606692 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 519/1058] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:24.609566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9fb80-70f7-4230-9de0-86bf1aeb26d3 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:24.717297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9fb80-70f7-4230-9de0-86bf1aeb26d3 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:24.751816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d8f9e-3cce-4727-94e7-78ee3195d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:24.752421 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d8f9e-3cce-4727-94e7-78ee3195d67d None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:24.752701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d8f9e-3cce-4727-94e7-78ee3195d67d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:24.752975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d8f9e-3cce-4727-94e7-78ee3195d67d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:24.753729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d8f9e-3cce-4727-94e7-78ee3195d67d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:24.755099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d8f9e-3cce-4727-94e7-78ee3195d67d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:24.834421 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 540/1059] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:07:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:24.846006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb4ff-91df-4115-8c70-cf5ba7947391 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:24.846285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb4ff-91df-4115-8c70-cf5ba7947391 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:24.846603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb4ff-91df-4115-8c70-cf5ba7947391 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:24.847976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 520/1060] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:24.853877 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f07b-af82-4f01-b600-cf8a3c0bc152 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:24.854160 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f07b-af82-4f01-b600-cf8a3c0bc152 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:24.854519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f07b-af82-4f01-b600-cf8a3c0bc152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:24.874626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3c00f07b-af82-4f01-b600-cf8a3c0bc152 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:24.875831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3c00f07b-af82-4f01-b600-cf8a3c0bc152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:24.884400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:24.956129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 541/1061] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:24.980492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abeb4ff-91df-4115-8c70-cf5ba7947391 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:25.090501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abeb4ff-91df-4115-8c70-cf5ba7947391 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:25.101023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:25.127206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec3754-120b-4d13-a50c-099f1065baa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:25.127838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec3754-120b-4d13-a50c-099f1065baa9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:25.128115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec3754-120b-4d13-a50c-099f1065baa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:25.128385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec3754-120b-4d13-a50c-099f1065baa9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:25.139907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec3754-120b-4d13-a50c-099f1065baa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-8eec3754-120b-4d13-a50c-099f1065baa9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:25.145124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:25.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:25.147659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 521/1062] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Aug 4 05:07:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:25.153890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00f07b-af82-4f01-b600-cf8a3c0bc152 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:25.263660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00f07b-af82-4f01-b600-cf8a3c0bc152 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:25.298902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0097720-958d-4411-9aab-b215b1f2ec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:25.299518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097720-958d-4411-9aab-b215b1f2ec70 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:25.299791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097720-958d-4411-9aab-b215b1f2ec70 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:25.300059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097720-958d-4411-9aab-b215b1f2ec70 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:25.300766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0097720-958d-4411-9aab-b215b1f2ec70 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:25.301089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0097720-958d-4411-9aab-b215b1f2ec70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:25.302470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0097720-958d-4411-9aab-b215b1f2ec70 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:25.307856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:25.317353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 542/1063] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Aug 4 05:07:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:25.318786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec3754-120b-4d13-a50c-099f1065baa9 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:25.429353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec3754-120b-4d13-a50c-099f1065baa9 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:25.452122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b258-ab7e-482e-8182-432798e69763 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:25.452429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b258-ab7e-482e-8182-432798e69763 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:25.452671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b258-ab7e-482e-8182-432798e69763 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:25.454018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 543/1064] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:07:25.459105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86cb1a-827f-4a40-8d98-7060658f818d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:25.459385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86cb1a-827f-4a40-8d98-7060658f818d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:25.459657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86cb1a-827f-4a40-8d98-7060658f818d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:25.465491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af117ba6-8132-4c67-9f7e-d6e3fd00bf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:25.466152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af117ba6-8132-4c67-9f7e-d6e3fd00bf37 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:25.466651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af117ba6-8132-4c67-9f7e-d6e3fd00bf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:25.466922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af117ba6-8132-4c67-9f7e-d6e3fd00bf37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:25.478067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9b86cb1a-827f-4a40-8d98-7060658f818d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:25.478352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af117ba6-8132-4c67-9f7e-d6e3fd00bf37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:25.479277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9b86cb1a-827f-4a40-8d98-7060658f818d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:25.480686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af117ba6-8132-4c67-9f7e-d6e3fd00bf37 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-af117ba6-8132-4c67-9f7e-d6e3fd00bf37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:25.496176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:25.497629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:25.498666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:25.498666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:25.498666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:25.498666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:25.501987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 522/1065] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:25.502911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af117ba6-8132-4c67-9f7e-d6e3fd00bf37 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:25.525122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:25.555001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 544/1066] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:25.579291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86cb1a-827f-4a40-8d98-7060658f818d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:25.606803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af117ba6-8132-4c67-9f7e-d6e3fd00bf37 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:25.641089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d300e51-d5df-45df-94b3-3fdc58ea9882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:25.641708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d300e51-d5df-45df-94b3-3fdc58ea9882 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:25.641986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d300e51-d5df-45df-94b3-3fdc58ea9882 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:25.642260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d300e51-d5df-45df-94b3-3fdc58ea9882 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:25.642973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d300e51-d5df-45df-94b3-3fdc58ea9882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:25.643280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d300e51-d5df-45df-94b3-3fdc58ea9882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:25.644645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d300e51-d5df-45df-94b3-3fdc58ea9882 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:25.661763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 523/1067] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:25.662665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d300e51-d5df-45df-94b3-3fdc58ea9882 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:25.688932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86cb1a-827f-4a40-8d98-7060658f818d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:25.720668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:25.726674 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d5ab9-5ec7-4bdc-bc7b-f7ae5adaf211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:25.727309 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d5ab9-5ec7-4bdc-bc7b-f7ae5adaf211 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:25.727584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d5ab9-5ec7-4bdc-bc7b-f7ae5adaf211 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:25.727855 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d5ab9-5ec7-4bdc-bc7b-f7ae5adaf211 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:25.738689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d5ab9-5ec7-4bdc-bc7b-f7ae5adaf211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-ea7d5ab9-5ec7-4bdc-bc7b-f7ae5adaf211 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:25.743552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:25.750013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:25.750986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 545/1068] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:07:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:25.751786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d5ab9-5ec7-4bdc-bc7b-f7ae5adaf211 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:25.754655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:25.776200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d300e51-d5df-45df-94b3-3fdc58ea9882 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:25.813602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ec8e8-5dc5-441e-ac23-b6facc354f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:25.814362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ec8e8-5dc5-441e-ac23-b6facc354f6a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:25.814643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ec8e8-5dc5-441e-ac23-b6facc354f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:25.814916 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ec8e8-5dc5-441e-ac23-b6facc354f6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:25.821928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ec8e8-5dc5-441e-ac23-b6facc354f6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:25.823381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ec8e8-5dc5-441e-ac23-b6facc354f6a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-133ec8e8-5dc5-441e-ac23-b6facc354f6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:07:25.835352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:25.836323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:25.837270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 524/1069] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 4 05:07:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:25.842985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ec8e8-5dc5-441e-ac23-b6facc354f6a None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:25.859914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d5ab9-5ec7-4bdc-bc7b-f7ae5adaf211 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:25.896335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb00da-0b2b-4749-8a98-7fa6fe149bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:25.896938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb00da-0b2b-4749-8a98-7fa6fe149bcd None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:25.897213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb00da-0b2b-4749-8a98-7fa6fe149bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:25.897483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb00da-0b2b-4749-8a98-7fa6fe149bcd None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:25.898200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb00da-0b2b-4749-8a98-7fa6fe149bcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:25.898597 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb00da-0b2b-4749-8a98-7fa6fe149bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:25.899947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb00da-0b2b-4749-8a98-7fa6fe149bcd None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:25.914245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 546/1070] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:07:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:25.914956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb00da-0b2b-4749-8a98-7fa6fe149bcd None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:25.963207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ec8e8-5dc5-441e-ac23-b6facc354f6a None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:25.976165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:25.999005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eacd1-ee77-468b-a284-88e039eedd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:25.999628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eacd1-ee77-468b-a284-88e039eedd70 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.000354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eacd1-ee77-468b-a284-88e039eedd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.000636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eacd1-ee77-468b-a284-88e039eedd70 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.001439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eacd1-ee77-468b-a284-88e039eedd70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:26.001749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eacd1-ee77-468b-a284-88e039eedd70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:26.003219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eacd1-ee77-468b-a284-88e039eedd70 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:26.014208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:26.029982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 525/1071] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 4 05:07:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:26.031167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eacd1-ee77-468b-a284-88e039eedd70 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:26.034447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb00da-0b2b-4749-8a98-7fa6fe149bcd None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:26.069194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a154a-a895-4fa5-8de1-79bd19c581cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:26.069830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a154a-a895-4fa5-8de1-79bd19c581cc None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.070103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a154a-a895-4fa5-8de1-79bd19c581cc None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.070398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a154a-a895-4fa5-8de1-79bd19c581cc None admin] PATH_INFO: `/v3/users/0e794b20b7084392a03e1d0d839668c7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.071556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a154a-a895-4fa5-8de1-79bd19c581cc None admin] RBAC: Authorizing `identity:get_user(user_id=0e794b20b7084392a03e1d0d839668c7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:26.072955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a154a-a895-4fa5-8de1-79bd19c581cc None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:26.075270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 547/1072] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:25 2022] GET /identity/v3/users/0e794b20b7084392a03e1d0d839668c7 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:26.080632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a154a-a895-4fa5-8de1-79bd19c581cc None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:26.142536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eacd1-ee77-468b-a284-88e039eedd70 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:26.186139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbb3a4-24d8-4a9a-a716-387a4e9d6d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:26.186808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbb3a4-24d8-4a9a-a716-387a4e9d6d84 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.187083 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbb3a4-24d8-4a9a-a716-387a4e9d6d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.187349 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbb3a4-24d8-4a9a-a716-387a4e9d6d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.197993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a154a-a895-4fa5-8de1-79bd19c581cc None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:26.198527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbb3a4-24d8-4a9a-a716-387a4e9d6d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:26.200728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbb3a4-24d8-4a9a-a716-387a4e9d6d84 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-8fcbb3a4-24d8-4a9a-a716-387a4e9d6d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:26.216928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:26.217962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:26.218931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:26.218931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:26.218931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:26.218931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:26.218931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 526/1073] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:26.222893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:26.223765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbb3a4-24d8-4a9a-a716-387a4e9d6d84 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:26.237921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47161162-7f82-4861-b2d1-6d573e598e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:26.238587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161162-7f82-4861-b2d1-6d573e598e84 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.238859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161162-7f82-4861-b2d1-6d573e598e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.239124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161162-7f82-4861-b2d1-6d573e598e84 None admin] PATH_INFO: `/v3/projects/3b30f4b17edb4e52b209acb4ca61d772` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.240269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47161162-7f82-4861-b2d1-6d573e598e84 None admin] RBAC: Authorizing `identity:get_project(project_id=3b30f4b17edb4e52b209acb4ca61d772)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:26.241844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47161162-7f82-4861-b2d1-6d573e598e84 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:26.249469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 548/1074] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:07:26 2022] GET /identity/v3/projects/3b30f4b17edb4e52b209acb4ca61d772 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:26.250081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47161162-7f82-4861-b2d1-6d573e598e84 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:26.276072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:26.330667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbb3a4-24d8-4a9a-a716-387a4e9d6d84 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:26.356629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47161162-7f82-4861-b2d1-6d573e598e84 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:26.366939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fefa7b-0bed-473f-8ef3-97ce9c5a3335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:26.367556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fefa7b-0bed-473f-8ef3-97ce9c5a3335 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.367840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fefa7b-0bed-473f-8ef3-97ce9c5a3335 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.368121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fefa7b-0bed-473f-8ef3-97ce9c5a3335 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.368817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fefa7b-0bed-473f-8ef3-97ce9c5a3335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:26.369122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fefa7b-0bed-473f-8ef3-97ce9c5a3335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:26.371021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fefa7b-0bed-473f-8ef3-97ce9c5a3335 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:26.383878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 527/1075] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:26.389889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fefa7b-0bed-473f-8ef3-97ce9c5a3335 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:26.399910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7693e02-05ee-4a52-9207-c0b8fca68d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:26.400572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7693e02-05ee-4a52-9207-c0b8fca68d94 None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.400848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7693e02-05ee-4a52-9207-c0b8fca68d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.401115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7693e02-05ee-4a52-9207-c0b8fca68d94 None admin] PATH_INFO: `/v3/projects/3b30f4b17edb4e52b209acb4ca61d772/users/0e794b20b7084392a03e1d0d839668c7/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.403134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7693e02-05ee-4a52-9207-c0b8fca68d94 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b30f4b17edb4e52b209acb4ca61d772, user_id=0e794b20b7084392a03e1d0d839668c7, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:26.404551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7693e02-05ee-4a52-9207-c0b8fca68d94 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:26.475819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 549/1076] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:07:26 2022] PUT /identity/v3/projects/3b30f4b17edb4e52b209acb4ca61d772/users/0e794b20b7084392a03e1d0d839668c7/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:07:26.495447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fefa7b-0bed-473f-8ef3-97ce9c5a3335 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:26.509064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:26.536625 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3369c8-f0f4-4fad-8e34-59caeb512974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:26.537390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3369c8-f0f4-4fad-8e34-59caeb512974 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.537663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3369c8-f0f4-4fad-8e34-59caeb512974 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.537932 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3369c8-f0f4-4fad-8e34-59caeb512974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.546526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3369c8-f0f4-4fad-8e34-59caeb512974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:26.548256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3369c8-f0f4-4fad-8e34-59caeb512974 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-4e3369c8-f0f4-4fad-8e34-59caeb512974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:07:26.561987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:26.563017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:26.563943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:07:26.563943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:07:26.563943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:07:26.563943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:07:26.563943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:07:26.563943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:07:26.563943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:26.563943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:26.563943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 528/1077] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:26.570353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7693e02-05ee-4a52-9207-c0b8fca68d94 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:26.628451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:26.684456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7693e02-05ee-4a52-9207-c0b8fca68d94 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:26.722689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e90c-3fdc-493c-a251-35a3edb5c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:26.723309 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e90c-3fdc-493c-a251-35a3edb5c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.723587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e90c-3fdc-493c-a251-35a3edb5c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.723858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e90c-3fdc-493c-a251-35a3edb5c7d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.724605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288e90c-3fdc-493c-a251-35a3edb5c7d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:26.724912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288e90c-3fdc-493c-a251-35a3edb5c7d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:26.726394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288e90c-3fdc-493c-a251-35a3edb5c7d2 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:26.739090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 550/1078] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:07:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:26.745499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3369c8-f0f4-4fad-8e34-59caeb512974 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:26.892223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3369c8-f0f4-4fad-8e34-59caeb512974 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:26.926822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffbb27-1f93-42ea-a960-8890b0c6d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:26.927488 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffbb27-1f93-42ea-a960-8890b0c6d3db None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.927768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffbb27-1f93-42ea-a960-8890b0c6d3db None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.928043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffbb27-1f93-42ea-a960-8890b0c6d3db None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/27f7331502484928ba7f8a4b403bdddd/roles/343dc7bf754f4d9a9c48b8579b46f26c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.930233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffbb27-1f93-42ea-a960-8890b0c6d3db None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=27f7331502484928ba7f8a4b403bdddd, role_id=343dc7bf754f4d9a9c48b8579b46f26c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:26.931705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffbb27-1f93-42ea-a960-8890b0c6d3db None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:26.961294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3ff05-2da9-43a2-98f7-d187b42a9512 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.961947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3ff05-2da9-43a2-98f7-d187b42a9512 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.962501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3ff05-2da9-43a2-98f7-d187b42a9512 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.964099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 551/1079] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:07:26.969913 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd76185-f7ee-463e-ab4b-736b72ad2726 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:26.970266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd76185-f7ee-463e-ab4b-736b72ad2726 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:26.970633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd76185-f7ee-463e-ab4b-736b72ad2726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:26.988960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-7bd76185-f7ee-463e-ab4b-736b72ad2726 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:26.990184 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7bd76185-f7ee-463e-ab4b-736b72ad2726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:27.048951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 529/1080] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:07:26 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/27f7331502484928ba7f8a4b403bdddd/roles/343dc7bf754f4d9a9c48b8579b46f26c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:07:27.065446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 552/1081] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:27.089795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffbb27-1f93-42ea-a960-8890b0c6d3db None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:27.127258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:27.209205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffbb27-1f93-42ea-a960-8890b0c6d3db None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:27.246873 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19dd49-7b8a-4834-93ed-159b429c571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:27.247413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19dd49-7b8a-4834-93ed-159b429c571d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:27.247770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19dd49-7b8a-4834-93ed-159b429c571d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:27.248045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19dd49-7b8a-4834-93ed-159b429c571d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:27.327694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19dd49-7b8a-4834-93ed-159b429c571d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:27.329148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19dd49-7b8a-4834-93ed-159b429c571d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:27.358561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:27.431194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 530/1082] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:07:27.437688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd76185-f7ee-463e-ab4b-736b72ad2726 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:27.476990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:27.540225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd76185-f7ee-463e-ab4b-736b72ad2726 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:27.577631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfab926-3e41-445d-8fdd-b2d49d0c2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:27.578272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfab926-3e41-445d-8fdd-b2d49d0c2cee None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:27.578577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfab926-3e41-445d-8fdd-b2d49d0c2cee None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:27.578848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfab926-3e41-445d-8fdd-b2d49d0c2cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:27.590137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfab926-3e41-445d-8fdd-b2d49d0c2cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:27.591376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfab926-3e41-445d-8fdd-b2d49d0c2cee None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-dbfab926-3e41-445d-8fdd-b2d49d0c2cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:27.608050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:27.609014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:27.609939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:27.609939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:27.609939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:27.609939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:27.609939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 553/1083] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:27.615715 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19dd49-7b8a-4834-93ed-159b429c571d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:27.720224 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19dd49-7b8a-4834-93ed-159b429c571d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:27.749725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:27.756357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f4430-f007-49eb-a337-ea8ad4c6eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:27.757051 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f4430-f007-49eb-a337-ea8ad4c6eed2 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:27.757402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f4430-f007-49eb-a337-ea8ad4c6eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:27.757744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f4430-f007-49eb-a337-ea8ad4c6eed2 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:27.758552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f4430-f007-49eb-a337-ea8ad4c6eed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:27.758928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f4430-f007-49eb-a337-ea8ad4c6eed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:27.760457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f4430-f007-49eb-a337-ea8ad4c6eed2 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:27.772826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 531/1084] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:28.531567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c206e-f002-400b-85a0-ebcedbf46113 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:28.532168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c206e-f002-400b-85a0-ebcedbf46113 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:28.532168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c206e-f002-400b-85a0-ebcedbf46113 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:28.533263 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 554/1085] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:28.538757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a236e19-cb32-4137-a398-eec67896b76c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:28.539182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a236e19-cb32-4137-a398-eec67896b76c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:28.539445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a236e19-cb32-4137-a398-eec67896b76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:28.558778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-7a236e19-cb32-4137-a398-eec67896b76c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:28.559961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7a236e19-cb32-4137-a398-eec67896b76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:28.627259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 532/1086] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:28.651461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c206e-f002-400b-85a0-ebcedbf46113 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:28.745047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:28.756004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c206e-f002-400b-85a0-ebcedbf46113 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:28.788118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54068a-3a88-4314-a677-58825c992055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:28.788673 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54068a-3a88-4314-a677-58825c992055 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:28.788948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54068a-3a88-4314-a677-58825c992055 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:28.789211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54068a-3a88-4314-a677-58825c992055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:28.800938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54068a-3a88-4314-a677-58825c992055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-5f54068a-3a88-4314-a677-58825c992055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:28.805827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:28.806883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:28.807908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 555/1087] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:07:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:28.814105 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a236e19-cb32-4137-a398-eec67896b76c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:28.911968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a236e19-cb32-4137-a398-eec67896b76c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:28.932609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:28.947150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdfd3c-a922-4f99-bd03-544773e1b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:28.949331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdfd3c-a922-4f99-bd03-544773e1b6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:28.949331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdfd3c-a922-4f99-bd03-544773e1b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:28.949331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdfd3c-a922-4f99-bd03-544773e1b6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:28.949331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdfd3c-a922-4f99-bd03-544773e1b6d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:28.949706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdfd3c-a922-4f99-bd03-544773e1b6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:28.950741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdfd3c-a922-4f99-bd03-544773e1b6d9 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:28.958540 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 533/1088] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:28.964585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54068a-3a88-4314-a677-58825c992055 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:29.064467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54068a-3a88-4314-a677-58825c992055 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:29.096585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac15d22-b061-456b-980b-1fea6d9bf58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:29.097204 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15d22-b061-456b-980b-1fea6d9bf58f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:29.097476 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15d22-b061-456b-980b-1fea6d9bf58f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:29.097741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15d22-b061-456b-980b-1fea6d9bf58f None admin] PATH_INFO: `/v3/users/0e794b20b7084392a03e1d0d839668c7` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:29.098903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac15d22-b061-456b-980b-1fea6d9bf58f None admin] RBAC: Authorizing `identity:get_user(user_id=0e794b20b7084392a03e1d0d839668c7)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:29.100305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac15d22-b061-456b-980b-1fea6d9bf58f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:29.101893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 556/1089] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:28 2022] GET /identity/v3/users/0e794b20b7084392a03e1d0d839668c7 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:29.108445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdfd3c-a922-4f99-bd03-544773e1b6d9 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:29.126542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672cdcc-480e-4282-8622-21c4de4bb74a None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:29.126814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672cdcc-480e-4282-8622-21c4de4bb74a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:29.127087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672cdcc-480e-4282-8622-21c4de4bb74a None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:29.128423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 557/1090] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:07:29.133175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef46085-56da-4c65-a045-ce381edf64aa None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:29.133460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef46085-56da-4c65-a045-ce381edf64aa None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:29.133730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef46085-56da-4c65-a045-ce381edf64aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:29.152317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-bef46085-56da-4c65-a045-ce381edf64aa None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:29.153586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bef46085-56da-4c65-a045-ce381edf64aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:29.168983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:29.213249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdfd3c-a922-4f99-bd03-544773e1b6d9 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:29.224393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 558/1091] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:29.248434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef46085-56da-4c65-a045-ce381edf64aa None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:29.249267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ad5c-deb2-48b0-9e01-66ecf57b4117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:29.249883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ad5c-deb2-48b0-9e01-66ecf57b4117 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:29.250162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ad5c-deb2-48b0-9e01-66ecf57b4117 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:29.250468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ad5c-deb2-48b0-9e01-66ecf57b4117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:29.306257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:29.324277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515ad5c-deb2-48b0-9e01-66ecf57b4117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:29.325639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515ad5c-deb2-48b0-9e01-66ecf57b4117 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:29.352224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef46085-56da-4c65-a045-ce381edf64aa None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:29.389349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f291de3-5dda-4a24-9a7b-de235ae0502f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:29.389982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f291de3-5dda-4a24-9a7b-de235ae0502f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:29.390260 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f291de3-5dda-4a24-9a7b-de235ae0502f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:29.390571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f291de3-5dda-4a24-9a7b-de235ae0502f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:29.400886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f291de3-5dda-4a24-9a7b-de235ae0502f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3f291de3-5dda-4a24-9a7b-de235ae0502f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:29.406517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:29.407475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:29.408321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 559/1092] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Aug 4 05:07:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:29.413668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f291de3-5dda-4a24-9a7b-de235ae0502f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:29.425526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:29.430162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 534/1093] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:07:29.436551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ad5c-deb2-48b0-9e01-66ecf57b4117 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:29.519223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f291de3-5dda-4a24-9a7b-de235ae0502f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:29.519486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:29.537778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ad5c-deb2-48b0-9e01-66ecf57b4117 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:29.555488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c948da3-7fa1-443a-b623-59942009f4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:29.556165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c948da3-7fa1-443a-b623-59942009f4ed None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:29.556480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c948da3-7fa1-443a-b623-59942009f4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:29.556753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c948da3-7fa1-443a-b623-59942009f4ed None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:29.557462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c948da3-7fa1-443a-b623-59942009f4ed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:29.557752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c948da3-7fa1-443a-b623-59942009f4ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:29.559820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c948da3-7fa1-443a-b623-59942009f4ed None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:29.567947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 560/1094] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Aug 4 05:07:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:29.574526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c948da3-7fa1-443a-b623-59942009f4ed None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:29.574704 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a102ac-d589-4564-a5f2-c876c8b3b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:29.575301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a102ac-d589-4564-a5f2-c876c8b3b798 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:29.575577 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a102ac-d589-4564-a5f2-c876c8b3b798 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:29.575849 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a102ac-d589-4564-a5f2-c876c8b3b798 None admin] PATH_INFO: `/v3/projects/3b30f4b17edb4e52b209acb4ca61d772` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:29.577015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a102ac-d589-4564-a5f2-c876c8b3b798 None admin] RBAC: Authorizing `identity:get_project(project_id=3b30f4b17edb4e52b209acb4ca61d772)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:29.578510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a102ac-d589-4564-a5f2-c876c8b3b798 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:29.580167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 535/1095] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:07:29 2022] GET /identity/v3/projects/3b30f4b17edb4e52b209acb4ca61d772 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:29.586038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a102ac-d589-4564-a5f2-c876c8b3b798 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:29.644934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:29.676989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c948da3-7fa1-443a-b623-59942009f4ed None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:29.687332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a102ac-d589-4564-a5f2-c876c8b3b798 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:29.711014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed251c9-ebe2-47b8-bbed-0fb8e722c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:29.711711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed251c9-ebe2-47b8-bbed-0fb8e722c7dd None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:29.711983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed251c9-ebe2-47b8-bbed-0fb8e722c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:29.712252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed251c9-ebe2-47b8-bbed-0fb8e722c7dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:29.723749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed251c9-ebe2-47b8-bbed-0fb8e722c7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:29.725219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed251c9-ebe2-47b8-bbed-0fb8e722c7dd None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:29.729580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71982b-10a6-4af1-b3fd-e1414e71735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:29.730582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71982b-10a6-4af1-b3fd-e1414e71735c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:29.730859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71982b-10a6-4af1-b3fd-e1414e71735c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:29.731249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71982b-10a6-4af1-b3fd-e1414e71735c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:29.732042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71982b-10a6-4af1-b3fd-e1414e71735c None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=3b30f4b17edb4e52b209acb4ca61d772, user.id=0e794b20b7084392a03e1d0d839668c7) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:29.732340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71982b-10a6-4af1-b3fd-e1414e71735c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:29.733799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71982b-10a6-4af1-b3fd-e1414e71735c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:29.739495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 536/1096] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:07:29 2022] GET /identity/v3/role_assignments?user.id=0e794b20b7084392a03e1d0d839668c7&scope.project.id=3b30f4b17edb4e52b209acb4ca61d772&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-bed251c9-ebe2-47b8-bbed-0fb8e722c7dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:29.740390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:29.741498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:29.742423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:29.742423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:29.742423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:29.742423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:29.742423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 561/1097] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:07:29.751509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71982b-10a6-4af1-b3fd-e1414e71735c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:29.769925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:29.898927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71982b-10a6-4af1-b3fd-e1414e71735c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:29.933319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d28f5-3a6f-4a99-b330-28131255623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:29.934019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d28f5-3a6f-4a99-b330-28131255623c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:29.934299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d28f5-3a6f-4a99-b330-28131255623c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:29.934606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d28f5-3a6f-4a99-b330-28131255623c None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:29.935297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d28f5-3a6f-4a99-b330-28131255623c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:29.935597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d28f5-3a6f-4a99-b330-28131255623c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:29.936990 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d28f5-3a6f-4a99-b330-28131255623c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:29.948859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 537/1098] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:29.954758 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed251c9-ebe2-47b8-bbed-0fb8e722c7dd None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:30.057456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed251c9-ebe2-47b8-bbed-0fb8e722c7dd None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:30.080284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:30.092794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ba4a5-be7d-4dcc-a9f3-02ddc636dcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:30.093479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ba4a5-be7d-4dcc-a9f3-02ddc636dcbc None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:30.093751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ba4a5-be7d-4dcc-a9f3-02ddc636dcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:30.094042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ba4a5-be7d-4dcc-a9f3-02ddc636dcbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:30.102352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ba4a5-be7d-4dcc-a9f3-02ddc636dcbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:30.103779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ba4a5-be7d-4dcc-a9f3-02ddc636dcbc None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-415ba4a5-be7d-4dcc-a9f3-02ddc636dcbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:07:30.115985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:30.123514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:30.124495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 562/1099] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Aug 4 05:07:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:30.125119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d28f5-3a6f-4a99-b330-28131255623c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:30.202846 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:30.228052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d28f5-3a6f-4a99-b330-28131255623c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:30.263125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f8ec7-7227-48b6-bed0-25afe77be2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:30.263741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8ec7-7227-48b6-bed0-25afe77be2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:30.264022 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8ec7-7227-48b6-bed0-25afe77be2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:30.264297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8ec7-7227-48b6-bed0-25afe77be2b5 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:30.265093 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f8ec7-7227-48b6-bed0-25afe77be2b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:30.265400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f8ec7-7227-48b6-bed0-25afe77be2b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:30.266879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f8ec7-7227-48b6-bed0-25afe77be2b5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:30.284671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 538/1100] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Aug 4 05:07:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:30.290413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ba4a5-be7d-4dcc-a9f3-02ddc636dcbc None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:30.387973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ba4a5-be7d-4dcc-a9f3-02ddc636dcbc None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:30.421206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d0ed4-5c2a-46ee-94db-9c10e716de08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:30.421731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0ed4-5c2a-46ee-94db-9c10e716de08 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:30.422265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0ed4-5c2a-46ee-94db-9c10e716de08 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:30.422559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0ed4-5c2a-46ee-94db-9c10e716de08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:30.472414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:30.490210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d0ed4-5c2a-46ee-94db-9c10e716de08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:30.491831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d0ed4-5c2a-46ee-94db-9c10e716de08 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:30.589138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 563/1101] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 05:07:30.595845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f8ec7-7227-48b6-bed0-25afe77be2b5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:30.695907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f8ec7-7227-48b6-bed0-25afe77be2b5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:30.725030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:30.730575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4a78-2fff-49e3-ba8f-48c6f5aeb4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:30.731214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4a78-2fff-49e3-ba8f-48c6f5aeb4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:30.731492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4a78-2fff-49e3-ba8f-48c6f5aeb4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:30.731763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4a78-2fff-49e3-ba8f-48c6f5aeb4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:30.741814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d4a78-2fff-49e3-ba8f-48c6f5aeb4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:30.743282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d4a78-2fff-49e3-ba8f-48c6f5aeb4a2 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-3d0d4a78-2fff-49e3-ba8f-48c6f5aeb4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:30.757464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:30.758383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:30.759285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:07:30.759285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:30.759285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:07:30.759285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:30.759285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 539/1102] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:30.764387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d0ed4-5c2a-46ee-94db-9c10e716de08 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:30.846079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:30.864011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d0ed4-5c2a-46ee-94db-9c10e716de08 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:30.899112 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dfe2d-1ed9-4998-a985-c803d9ba956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:30.899728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfe2d-1ed9-4998-a985-c803d9ba956b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:30.900001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfe2d-1ed9-4998-a985-c803d9ba956b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:30.900271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfe2d-1ed9-4998-a985-c803d9ba956b None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:30.900953 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dfe2d-1ed9-4998-a985-c803d9ba956b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:30.901259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dfe2d-1ed9-4998-a985-c803d9ba956b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:30.903166 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dfe2d-1ed9-4998-a985-c803d9ba956b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:30.914843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 564/1103] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:30.921222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4a78-2fff-49e3-ba8f-48c6f5aeb4a2 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:31.020050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4a78-2fff-49e3-ba8f-48c6f5aeb4a2 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:31.053691 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559c66-5469-41c2-b038-521d9cf6f551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:31.054333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559c66-5469-41c2-b038-521d9cf6f551 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:31.054616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559c66-5469-41c2-b038-521d9cf6f551 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:31.054885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559c66-5469-41c2-b038-521d9cf6f551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:31.061584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54559c66-5469-41c2-b038-521d9cf6f551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:31.063071 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54559c66-5469-41c2-b038-521d9cf6f551 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-54559c66-5469-41c2-b038-521d9cf6f551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:07:31.074552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:31.075483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:31.076381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:07:31.076381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:07:31.076381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:07:31.076381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:07:31.076381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:07:31.076381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:07:31.076381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:07:31.076381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:31.076381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 540/1104] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:07:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:31.081519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dfe2d-1ed9-4998-a985-c803d9ba956b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:31.187161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dfe2d-1ed9-4998-a985-c803d9ba956b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:31.222183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9d1e5-1bbe-4708-b44f-d8937794a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:31.222897 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9d1e5-1bbe-4708-b44f-d8937794a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:31.223171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9d1e5-1bbe-4708-b44f-d8937794a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:31.223440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9d1e5-1bbe-4708-b44f-d8937794a3e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:31.224210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9d1e5-1bbe-4708-b44f-d8937794a3e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:31.224587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9d1e5-1bbe-4708-b44f-d8937794a3e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:31.226022 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9d1e5-1bbe-4708-b44f-d8937794a3e5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:31.238816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 565/1105] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:07:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:31.244771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559c66-5469-41c2-b038-521d9cf6f551 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:31.291520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:31.348685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559c66-5469-41c2-b038-521d9cf6f551 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:31.383552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c20f0-4c16-4972-af59-ae675e836fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:31.388325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c20f0-4c16-4972-af59-ae675e836fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:31.388325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c20f0-4c16-4972-af59-ae675e836fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:31.388325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c20f0-4c16-4972-af59-ae675e836fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:31.388325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c20f0-4c16-4972-af59-ae675e836fd5 None admin] RBAC: Adding query filter params (role.id=343dc7bf754f4d9a9c48b8579b46f26c, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=27f7331502484928ba7f8a4b403bdddd) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:31.388325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c20f0-4c16-4972-af59-ae675e836fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:31.388325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c20f0-4c16-4972-af59-ae675e836fd5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:31.393437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 541/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:07:31 2022] GET /identity/v3/role_assignments?user.id=27f7331502484928ba7f8a4b403bdddd&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=343dc7bf754f4d9a9c48b8579b46f26c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:31.804382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8dd5-74dd-4342-8369-91b3b096e796 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:31.804945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8dd5-74dd-4342-8369-91b3b096e796 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:31.804945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8dd5-74dd-4342-8369-91b3b096e796 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:31.806273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 566/1107] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:31.812045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72692-458c-42f0-bf43-8a9f1a15b579 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:31.812513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72692-458c-42f0-bf43-8a9f1a15b579 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:31.812619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72692-458c-42f0-bf43-8a9f1a15b579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:31.831191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ffa72692-458c-42f0-bf43-8a9f1a15b579 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:31.832376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ffa72692-458c-42f0-bf43-8a9f1a15b579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:31.908894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 542/1108] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:31.934047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8dd5-74dd-4342-8369-91b3b096e796 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:31.937249 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:32.042276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8dd5-74dd-4342-8369-91b3b096e796 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:32.080084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b756a24-9e41-498d-bd6c-b4b7d94cff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:32.080713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b756a24-9e41-498d-bd6c-b4b7d94cff53 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:32.080943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b756a24-9e41-498d-bd6c-b4b7d94cff53 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:32.081208 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b756a24-9e41-498d-bd6c-b4b7d94cff53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:32.082357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b756a24-9e41-498d-bd6c-b4b7d94cff53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:32.083781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b756a24-9e41-498d-bd6c-b4b7d94cff53 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:32.085352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 567/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:32.092097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72692-458c-42f0-bf43-8a9f1a15b579 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:32.133643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:32.197094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72692-458c-42f0-bf43-8a9f1a15b579 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:32.232974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559b85-769b-4763-8d4c-3ff834ad455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:32.233599 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559b85-769b-4763-8d4c-3ff834ad455c None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:32.233878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559b85-769b-4763-8d4c-3ff834ad455c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:32.234153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559b85-769b-4763-8d4c-3ff834ad455c None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:32.234901 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54559b85-769b-4763-8d4c-3ff834ad455c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:32.236500 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54559b85-769b-4763-8d4c-3ff834ad455c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:32.368482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 543/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:07:32 2022] POST /identity/v3/users => generated 286 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:34.413842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f9fe4-5e86-4024-a44c-25e553d0bb5d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:34.414451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f9fe4-5e86-4024-a44c-25e553d0bb5d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:34.414451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f9fe4-5e86-4024-a44c-25e553d0bb5d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:34.415739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 568/1111] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:34.422220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b2304-d1cb-49e3-9d72-135282b1f62e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:34.422696 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b2304-d1cb-49e3-9d72-135282b1f62e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:34.422790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b2304-d1cb-49e3-9d72-135282b1f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:34.441740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b85b2304-d1cb-49e3-9d72-135282b1f62e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:34.442965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b85b2304-d1cb-49e3-9d72-135282b1f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:34.510092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 544/1112] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:34.533957 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f9fe4-5e86-4024-a44c-25e553d0bb5d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:34.604898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:34.635501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f9fe4-5e86-4024-a44c-25e553d0bb5d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:34.669561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fa64b-a4c3-4fa5-b5ec-2c3122d2ad0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:34.670190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fa64b-a4c3-4fa5-b5ec-2c3122d2ad0e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:34.670500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fa64b-a4c3-4fa5-b5ec-2c3122d2ad0e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:34.670772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fa64b-a4c3-4fa5-b5ec-2c3122d2ad0e None admin] PATH_INFO: `/v3/roles/ac5a79a4ca8d49298d455da9928e5a4f` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:34.672551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fa64b-a4c3-4fa5-b5ec-2c3122d2ad0e None admin] RBAC: Authorizing `identity:get_role(role_id=ac5a79a4ca8d49298d455da9928e5a4f)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:34.673835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fa64b-a4c3-4fa5-b5ec-2c3122d2ad0e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:34.675203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 569/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:34 2022] GET /identity/v3/roles/ac5a79a4ca8d49298d455da9928e5a4f => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:34.681208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b2304-d1cb-49e3-9d72-135282b1f62e None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:34.706962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:34.782427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b2304-d1cb-49e3-9d72-135282b1f62e None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:34.818175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8dc3-48ec-4855-b9b8-26350c980409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:34.818844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8dc3-48ec-4855-b9b8-26350c980409 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:34.819125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8dc3-48ec-4855-b9b8-26350c980409 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:34.819400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8dc3-48ec-4855-b9b8-26350c980409 None admin] PATH_INFO: `/v3/users/a0c3bc2667af4c86951e561c52b623a5` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:34.832747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c8dc3-48ec-4855-b9b8-26350c980409 None admin] RBAC: Authorizing `identity:get_user(user_id=a0c3bc2667af4c86951e561c52b623a5)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:34.834237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c8dc3-48ec-4855-b9b8-26350c980409 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:34.839949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 545/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:34 2022] GET /identity/v3/users/a0c3bc2667af4c86951e561c52b623a5 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:34.842089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fa64b-a4c3-4fa5-b5ec-2c3122d2ad0e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:34.940727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fa64b-a4c3-4fa5-b5ec-2c3122d2ad0e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:34.972861 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1360f-3d11-4de6-9824-a68c46dd58b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:34.973457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1360f-3d11-4de6-9824-a68c46dd58b1 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:34.973729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1360f-3d11-4de6-9824-a68c46dd58b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:34.974000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1360f-3d11-4de6-9824-a68c46dd58b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:34.982412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:35.038583 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1360f-3d11-4de6-9824-a68c46dd58b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:35.040038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1360f-3d11-4de6-9824-a68c46dd58b1 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:35.135867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 570/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:07:35.141951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8dc3-48ec-4855-b9b8-26350c980409 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:35.225521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:35.243675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8dc3-48ec-4855-b9b8-26350c980409 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:35.276559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d093139-cf5b-4992-a6a8-6bdcde21355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:35.277944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d093139-cf5b-4992-a6a8-6bdcde21355d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:35.278284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d093139-cf5b-4992-a6a8-6bdcde21355d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:35.278949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d093139-cf5b-4992-a6a8-6bdcde21355d None admin] PATH_INFO: `/v3/projects/3b30f4b17edb4e52b209acb4ca61d772` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:35.280193 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d093139-cf5b-4992-a6a8-6bdcde21355d None admin] RBAC: Authorizing `identity:get_project(project_id=3b30f4b17edb4e52b209acb4ca61d772)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:35.281657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d093139-cf5b-4992-a6a8-6bdcde21355d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:35.283507 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 546/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:07:35 2022] GET /identity/v3/projects/3b30f4b17edb4e52b209acb4ca61d772 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:35.289794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1360f-3d11-4de6-9824-a68c46dd58b1 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:35.329972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:35.389236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1360f-3d11-4de6-9824-a68c46dd58b1 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:35.443713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88792a26-a4ed-40ee-a7a3-21554d6a8cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:35.444368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88792a26-a4ed-40ee-a7a3-21554d6a8cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:35.444568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88792a26-a4ed-40ee-a7a3-21554d6a8cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:35.444836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88792a26-a4ed-40ee-a7a3-21554d6a8cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:35.445611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88792a26-a4ed-40ee-a7a3-21554d6a8cf2 None admin] RBAC: Adding query filter params (role.id=ac5a79a4ca8d49298d455da9928e5a4f, scope.project.id=3b30f4b17edb4e52b209acb4ca61d772, user.id=a0c3bc2667af4c86951e561c52b623a5) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:35.445910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88792a26-a4ed-40ee-a7a3-21554d6a8cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:35.447373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88792a26-a4ed-40ee-a7a3-21554d6a8cf2 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:35.452942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 571/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:07:35 2022] GET /identity/v3/role_assignments?user.id=a0c3bc2667af4c86951e561c52b623a5&scope.project.id=3b30f4b17edb4e52b209acb4ca61d772&role.id=ac5a79a4ca8d49298d455da9928e5a4f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:37.456822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783b937-06b5-4af5-a22b-d759b775df1a None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:37.457346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783b937-06b5-4af5-a22b-d759b775df1a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:37.457346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783b937-06b5-4af5-a22b-d759b775df1a None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:37.458674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 547/1118] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:37.463988 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e50e4-773b-4979-a8d0-e48413580021 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:37.465074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e50e4-773b-4979-a8d0-e48413580021 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:37.465556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e50e4-773b-4979-a8d0-e48413580021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:37.483990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-219e50e4-773b-4979-a8d0-e48413580021 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:37.485157 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-219e50e4-773b-4979-a8d0-e48413580021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:37.551251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 572/1119] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:37.573977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783b937-06b5-4af5-a22b-d759b775df1a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:37.674941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783b937-06b5-4af5-a22b-d759b775df1a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:37.707854 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831761d-4577-426f-b6f6-b133376c29e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:37.708412 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831761d-4577-426f-b6f6-b133376c29e7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:37.708695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831761d-4577-426f-b6f6-b133376c29e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:37.708968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831761d-4577-426f-b6f6-b133376c29e7 None admin] PATH_INFO: `/v3/roles/ac5a79a4ca8d49298d455da9928e5a4f` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:37.710462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831761d-4577-426f-b6f6-b133376c29e7 None admin] RBAC: Authorizing `identity:get_role(role_id=ac5a79a4ca8d49298d455da9928e5a4f)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:37.711824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831761d-4577-426f-b6f6-b133376c29e7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:37.713179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 548/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:37 2022] GET /identity/v3/roles/ac5a79a4ca8d49298d455da9928e5a4f => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:37.719929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e50e4-773b-4979-a8d0-e48413580021 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:37.749892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:37.816416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e50e4-773b-4979-a8d0-e48413580021 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:37.849928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49793dcf-c1d4-41c2-bcca-31c8aec3941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:37.850567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49793dcf-c1d4-41c2-bcca-31c8aec3941d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:37.850838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49793dcf-c1d4-41c2-bcca-31c8aec3941d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:37.851104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49793dcf-c1d4-41c2-bcca-31c8aec3941d None admin] PATH_INFO: `/v3/users/a0c3bc2667af4c86951e561c52b623a5` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:37.852367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49793dcf-c1d4-41c2-bcca-31c8aec3941d None admin] RBAC: Authorizing `identity:get_user(user_id=a0c3bc2667af4c86951e561c52b623a5)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:37.853801 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49793dcf-c1d4-41c2-bcca-31c8aec3941d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:37.855695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 573/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:37 2022] GET /identity/v3/users/a0c3bc2667af4c86951e561c52b623a5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:37.861447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831761d-4577-426f-b6f6-b133376c29e7 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:37.880422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:37.960285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831761d-4577-426f-b6f6-b133376c29e7 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:37.993662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27808eb3-8165-4cf9-a7d6-b3ee8652837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:37.994291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808eb3-8165-4cf9-a7d6-b3ee8652837d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:37.994595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808eb3-8165-4cf9-a7d6-b3ee8652837d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:37.994863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808eb3-8165-4cf9-a7d6-b3ee8652837d None admin] PATH_INFO: `/v3/projects/3b30f4b17edb4e52b209acb4ca61d772` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:37.996205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27808eb3-8165-4cf9-a7d6-b3ee8652837d None admin] RBAC: Authorizing `identity:get_project(project_id=3b30f4b17edb4e52b209acb4ca61d772)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:37.997621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27808eb3-8165-4cf9-a7d6-b3ee8652837d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:37.999302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 549/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:07:37 2022] GET /identity/v3/projects/3b30f4b17edb4e52b209acb4ca61d772 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:38.005398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49793dcf-c1d4-41c2-bcca-31c8aec3941d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:38.105830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:38.108940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49793dcf-c1d4-41c2-bcca-31c8aec3941d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:38.143423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd6e11-a2d2-4c0f-b428-1625c091c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:38.144086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd6e11-a2d2-4c0f-b428-1625c091c44d None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:38.144559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd6e11-a2d2-4c0f-b428-1625c091c44d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:38.145058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd6e11-a2d2-4c0f-b428-1625c091c44d None admin] PATH_INFO: `/v3/projects/3b30f4b17edb4e52b209acb4ca61d772/users/a0c3bc2667af4c86951e561c52b623a5/roles/ac5a79a4ca8d49298d455da9928e5a4f` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:38.147519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd6e11-a2d2-4c0f-b428-1625c091c44d None admin] RBAC: Authorizing `identity:create_grant(project_id=3b30f4b17edb4e52b209acb4ca61d772, user_id=a0c3bc2667af4c86951e561c52b623a5, role_id=ac5a79a4ca8d49298d455da9928e5a4f)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:38.148957 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd6e11-a2d2-4c0f-b428-1625c091c44d None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:38.225791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 574/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:07:38 2022] PUT /identity/v3/projects/3b30f4b17edb4e52b209acb4ca61d772/users/a0c3bc2667af4c86951e561c52b623a5/roles/ac5a79a4ca8d49298d455da9928e5a4f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:07:40.235655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20610be-c38c-40ad-9333-ce3184b9cbfd None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:40.236203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20610be-c38c-40ad-9333-ce3184b9cbfd None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:40.236203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20610be-c38c-40ad-9333-ce3184b9cbfd None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:40.237670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 550/1124] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:40.242932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28cad-4807-4f8d-9368-3105d16d26a2 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:40.243312 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28cad-4807-4f8d-9368-3105d16d26a2 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:40.243472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28cad-4807-4f8d-9368-3105d16d26a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:40.262750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-d3e28cad-4807-4f8d-9368-3105d16d26a2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:40.263907 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d3e28cad-4807-4f8d-9368-3105d16d26a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:40.330400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 575/1125] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:40.354162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20610be-c38c-40ad-9333-ce3184b9cbfd None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:40.438946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:40.454786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20610be-c38c-40ad-9333-ce3184b9cbfd None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:40.487362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a5fa-c3a9-439a-a9e5-364f4de3637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:40.487978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a5fa-c3a9-439a-a9e5-364f4de3637d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:40.488252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a5fa-c3a9-439a-a9e5-364f4de3637d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:40.488525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a5fa-c3a9-439a-a9e5-364f4de3637d None admin] PATH_INFO: `/v3/roles/ac5a79a4ca8d49298d455da9928e5a4f` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:40.489930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876a5fa-c3a9-439a-a9e5-364f4de3637d None admin] RBAC: Authorizing `identity:get_role(role_id=ac5a79a4ca8d49298d455da9928e5a4f)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:40.491307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876a5fa-c3a9-439a-a9e5-364f4de3637d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:40.492633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 551/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:40 2022] GET /identity/v3/roles/ac5a79a4ca8d49298d455da9928e5a4f => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:40.499308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e28cad-4807-4f8d-9368-3105d16d26a2 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:40.584703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:40.593822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e28cad-4807-4f8d-9368-3105d16d26a2 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:40.626954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93f635-feae-4972-a658-233dc172955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:40.637891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93f635-feae-4972-a658-233dc172955a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:40.637891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93f635-feae-4972-a658-233dc172955a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:40.637891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93f635-feae-4972-a658-233dc172955a None admin] PATH_INFO: `/v3/users/a0c3bc2667af4c86951e561c52b623a5` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:40.637891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93f635-feae-4972-a658-233dc172955a None admin] RBAC: Authorizing `identity:get_user(user_id=a0c3bc2667af4c86951e561c52b623a5)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:40.637891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93f635-feae-4972-a658-233dc172955a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:40.637891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 576/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:40 2022] GET /identity/v3/users/a0c3bc2667af4c86951e561c52b623a5 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:40.639025 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a5fa-c3a9-439a-a9e5-364f4de3637d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:40.739838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a5fa-c3a9-439a-a9e5-364f4de3637d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:40.773545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79de6-7a72-4d00-8bd3-73468d9333ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:40.774201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79de6-7a72-4d00-8bd3-73468d9333ab None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:40.774515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79de6-7a72-4d00-8bd3-73468d9333ab None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:40.774788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79de6-7a72-4d00-8bd3-73468d9333ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:40.798453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:40.840626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c79de6-7a72-4d00-8bd3-73468d9333ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:40.842086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c79de6-7a72-4d00-8bd3-73468d9333ab None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:40.937420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 552/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:07:40.943709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93f635-feae-4972-a658-233dc172955a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:41.038802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93f635-feae-4972-a658-233dc172955a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:41.072070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f808648-2ba4-4d12-adae-9e52e9085faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:41.072682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808648-2ba4-4d12-adae-9e52e9085faa None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:41.072954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808648-2ba4-4d12-adae-9e52e9085faa None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:41.073245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808648-2ba4-4d12-adae-9e52e9085faa None admin] PATH_INFO: `/v3/projects/3b30f4b17edb4e52b209acb4ca61d772` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:41.074420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f808648-2ba4-4d12-adae-9e52e9085faa None admin] RBAC: Authorizing `identity:get_project(project_id=3b30f4b17edb4e52b209acb4ca61d772)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:41.075827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f808648-2ba4-4d12-adae-9e52e9085faa None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:41.077444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 577/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:07:40 2022] GET /identity/v3/projects/3b30f4b17edb4e52b209acb4ca61d772 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:41.083787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79de6-7a72-4d00-8bd3-73468d9333ab None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:41.137503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:41.183092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79de6-7a72-4d00-8bd3-73468d9333ab None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:41.215738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466732d-8f3b-4d82-bbd2-4acf93556765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:41.216340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466732d-8f3b-4d82-bbd2-4acf93556765 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:41.216620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466732d-8f3b-4d82-bbd2-4acf93556765 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:41.216893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466732d-8f3b-4d82-bbd2-4acf93556765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:41.217676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466732d-8f3b-4d82-bbd2-4acf93556765 None admin] RBAC: Adding query filter params (role.id=ac5a79a4ca8d49298d455da9928e5a4f, scope.project.id=3b30f4b17edb4e52b209acb4ca61d772, user.id=a0c3bc2667af4c86951e561c52b623a5) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:41.217983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466732d-8f3b-4d82-bbd2-4acf93556765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:41.219443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466732d-8f3b-4d82-bbd2-4acf93556765 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:41.225052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 553/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:07:41 2022] GET /identity/v3/role_assignments?user.id=a0c3bc2667af4c86951e561c52b623a5&scope.project.id=3b30f4b17edb4e52b209acb4ca61d772&role.id=ac5a79a4ca8d49298d455da9928e5a4f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:43.238845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0391c-0976-41c6-abdb-f0386243d7ec None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:43.239382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0391c-0976-41c6-abdb-f0386243d7ec None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:43.239382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0391c-0976-41c6-abdb-f0386243d7ec None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:43.240734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 578/1131] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:43.246735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37643ef-5237-44a4-9a29-65801099cf51 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:43.247144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37643ef-5237-44a4-9a29-65801099cf51 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:43.247284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37643ef-5237-44a4-9a29-65801099cf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:43.265217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b37643ef-5237-44a4-9a29-65801099cf51 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:43.266426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b37643ef-5237-44a4-9a29-65801099cf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:43.332437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 554/1132] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:43.356797 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0391c-0976-41c6-abdb-f0386243d7ec None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:43.384170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:43.459579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0391c-0976-41c6-abdb-f0386243d7ec None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:43.494012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0665f7e-b622-4b67-b89e-1cbf143824b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:43.494665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665f7e-b622-4b67-b89e-1cbf143824b5 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:43.494936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665f7e-b622-4b67-b89e-1cbf143824b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:43.495203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665f7e-b622-4b67-b89e-1cbf143824b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:43.496898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0665f7e-b622-4b67-b89e-1cbf143824b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:43.498315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0665f7e-b622-4b67-b89e-1cbf143824b5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:43.499902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 579/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:43.505858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37643ef-5237-44a4-9a29-65801099cf51 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:43.553816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:43.603457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37643ef-5237-44a4-9a29-65801099cf51 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:43.635787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a03f5-785b-449f-b1bb-979a31dc76ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:43.636415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a03f5-785b-449f-b1bb-979a31dc76ae None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:43.636684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a03f5-785b-449f-b1bb-979a31dc76ae None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:43.636950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a03f5-785b-449f-b1bb-979a31dc76ae None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:43.637623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a03f5-785b-449f-b1bb-979a31dc76ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:43.639060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a03f5-785b-449f-b1bb-979a31dc76ae None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:43.751003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 555/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:07:43 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:45.802206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783f8db-215e-44c2-a8d8-2ce12c0ee7fc None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:45.802771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783f8db-215e-44c2-a8d8-2ce12c0ee7fc None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:45.802771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783f8db-215e-44c2-a8d8-2ce12c0ee7fc None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:45.804183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 580/1135] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:45.809571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039101e-e47e-41e1-b190-452dc05aaed9 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:45.809991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039101e-e47e-41e1-b190-452dc05aaed9 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:45.810093 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039101e-e47e-41e1-b190-452dc05aaed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:45.827515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-a039101e-e47e-41e1-b190-452dc05aaed9 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:45.828693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a039101e-e47e-41e1-b190-452dc05aaed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:45.892817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 556/1136] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:07:45.918810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783f8db-215e-44c2-a8d8-2ce12c0ee7fc None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:46.011433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:46.018977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783f8db-215e-44c2-a8d8-2ce12c0ee7fc None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:46.053306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03c773-03cb-47a1-8844-4f31d6a2beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:46.053865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03c773-03cb-47a1-8844-4f31d6a2beea None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:46.054141 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03c773-03cb-47a1-8844-4f31d6a2beea None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:46.054441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03c773-03cb-47a1-8844-4f31d6a2beea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:46.055589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03c773-03cb-47a1-8844-4f31d6a2beea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:46.057049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03c773-03cb-47a1-8844-4f31d6a2beea None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:46.058731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 581/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:07:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:46.064675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039101e-e47e-41e1-b190-452dc05aaed9 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:46.094652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:46.163033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039101e-e47e-41e1-b190-452dc05aaed9 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:46.197792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1363b-b94b-42b2-a1c8-514eac0a83aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:46.199029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1363b-b94b-42b2-a1c8-514eac0a83aa None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:46.199238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1363b-b94b-42b2-a1c8-514eac0a83aa None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:46.199519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1363b-b94b-42b2-a1c8-514eac0a83aa None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:46.200202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1363b-b94b-42b2-a1c8-514eac0a83aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:46.201633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1363b-b94b-42b2-a1c8-514eac0a83aa None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:46.300219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 557/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:07:46 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:07:48.340167 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbe2d3-8bc9-4936-9f16-6d6ca2860c20 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:48.340697 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbe2d3-8bc9-4936-9f16-6d6ca2860c20 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:48.340697 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbe2d3-8bc9-4936-9f16-6d6ca2860c20 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:48.342038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 582/1139] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:48.347198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10169ca5-d3ac-4123-8404-5fb57183474c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:48.347619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10169ca5-d3ac-4123-8404-5fb57183474c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:48.347748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10169ca5-d3ac-4123-8404-5fb57183474c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:48.365840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-10169ca5-d3ac-4123-8404-5fb57183474c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:48.367059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-10169ca5-d3ac-4123-8404-5fb57183474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:48.431595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 558/1140] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:48.455000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbe2d3-8bc9-4936-9f16-6d6ca2860c20 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:48.555003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbe2d3-8bc9-4936-9f16-6d6ca2860c20 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:48.589057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858eac1-ec59-4e63-8983-4fae8af9b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:48.590361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858eac1-ec59-4e63-8983-4fae8af9b317 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:48.590643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858eac1-ec59-4e63-8983-4fae8af9b317 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:48.590921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858eac1-ec59-4e63-8983-4fae8af9b317 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:48.601136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858eac1-ec59-4e63-8983-4fae8af9b317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-d858eac1-ec59-4e63-8983-4fae8af9b317 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:48.606177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:48.607329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:48.608376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 583/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:48.613667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10169ca5-d3ac-4123-8404-5fb57183474c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:48.631045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:48.710550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10169ca5-d3ac-4123-8404-5fb57183474c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:48.743614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83570a-a5f0-4cee-b6d0-c34ab53c9305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:48.744228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83570a-a5f0-4cee-b6d0-c34ab53c9305 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:48.744505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83570a-a5f0-4cee-b6d0-c34ab53c9305 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:48.744776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83570a-a5f0-4cee-b6d0-c34ab53c9305 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:48.746018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83570a-a5f0-4cee-b6d0-c34ab53c9305 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:48.746335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83570a-a5f0-4cee-b6d0-c34ab53c9305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:48.747882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83570a-a5f0-4cee-b6d0-c34ab53c9305 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:48.755955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 559/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:48.762729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858eac1-ec59-4e63-8983-4fae8af9b317 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:48.788454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:48.861620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858eac1-ec59-4e63-8983-4fae8af9b317 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:48.895623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc286eae-03aa-4259-9eea-7e21523b208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:48.896250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc286eae-03aa-4259-9eea-7e21523b208c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:48.896527 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc286eae-03aa-4259-9eea-7e21523b208c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:48.896799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc286eae-03aa-4259-9eea-7e21523b208c None admin] PATH_INFO: `/v3/users/76abdc5b3fcb4e88af13ddcffa4aeb8f` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:48.909806 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc286eae-03aa-4259-9eea-7e21523b208c None admin] RBAC: Authorizing `identity:get_user(user_id=76abdc5b3fcb4e88af13ddcffa4aeb8f)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:48.911266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc286eae-03aa-4259-9eea-7e21523b208c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:48.912898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 584/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:48 2022] GET /identity/v3/users/76abdc5b3fcb4e88af13ddcffa4aeb8f => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:48.918941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83570a-a5f0-4cee-b6d0-c34ab53c9305 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:48.994895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:49.015726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83570a-a5f0-4cee-b6d0-c34ab53c9305 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:49.049143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2924913-d5bb-40b1-bf9a-312ac7c3f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:49.049747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2924913-d5bb-40b1-bf9a-312ac7c3f848 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:49.050023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2924913-d5bb-40b1-bf9a-312ac7c3f848 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:49.050292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2924913-d5bb-40b1-bf9a-312ac7c3f848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:49.116984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2924913-d5bb-40b1-bf9a-312ac7c3f848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:49.118445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2924913-d5bb-40b1-bf9a-312ac7c3f848 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:49.194912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:49.217587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 560/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 05:07:49.223533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc286eae-03aa-4259-9eea-7e21523b208c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:49.303018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:49.321478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc286eae-03aa-4259-9eea-7e21523b208c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:49.354589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91f1bf-cbbe-4e1f-bfd9-d0f6926d5b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:49.355932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f1bf-cbbe-4e1f-bfd9-d0f6926d5b31 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:49.356209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f1bf-cbbe-4e1f-bfd9-d0f6926d5b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:49.356483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f1bf-cbbe-4e1f-bfd9-d0f6926d5b31 None admin] PATH_INFO: `/v3/projects/37bb7f7b77a84316af3ae990864f7da3` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:49.357619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91f1bf-cbbe-4e1f-bfd9-d0f6926d5b31 None admin] RBAC: Authorizing `identity:get_project(project_id=37bb7f7b77a84316af3ae990864f7da3)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:49.359065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91f1bf-cbbe-4e1f-bfd9-d0f6926d5b31 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:49.360711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 585/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:07:49 2022] GET /identity/v3/projects/37bb7f7b77a84316af3ae990864f7da3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:49.367028 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2924913-d5bb-40b1-bf9a-312ac7c3f848 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:49.463253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2924913-d5bb-40b1-bf9a-312ac7c3f848 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:49.496887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57658f06-d6ea-4f74-b433-7a50565bc7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:49.497486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658f06-d6ea-4f74-b433-7a50565bc7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:49.497801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658f06-d6ea-4f74-b433-7a50565bc7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:49.498078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658f06-d6ea-4f74-b433-7a50565bc7d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:49.498902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57658f06-d6ea-4f74-b433-7a50565bc7d5 None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=37bb7f7b77a84316af3ae990864f7da3, user.id=76abdc5b3fcb4e88af13ddcffa4aeb8f) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:49.499214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57658f06-d6ea-4f74-b433-7a50565bc7d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:49.500634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57658f06-d6ea-4f74-b433-7a50565bc7d5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:49.505909 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 561/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:07:49 2022] GET /identity/v3/role_assignments?user.id=76abdc5b3fcb4e88af13ddcffa4aeb8f&scope.project.id=37bb7f7b77a84316af3ae990864f7da3&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:51.488967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890070f-c293-443a-8395-47c9f5147b48 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:51.489490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890070f-c293-443a-8395-47c9f5147b48 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:51.489490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890070f-c293-443a-8395-47c9f5147b48 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:51.490984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 586/1147] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:51.496977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d1bb0-a9a6-4d9d-89a9-4e427f819f25 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:51.497414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d1bb0-a9a6-4d9d-89a9-4e427f819f25 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:51.497523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d1bb0-a9a6-4d9d-89a9-4e427f819f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:51.515910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-fc4d1bb0-a9a6-4d9d-89a9-4e427f819f25 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:51.517122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-fc4d1bb0-a9a6-4d9d-89a9-4e427f819f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:51.552635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:51.583986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 562/1148] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:51.607713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890070f-c293-443a-8395-47c9f5147b48 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:51.712307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890070f-c293-443a-8395-47c9f5147b48 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:51.747009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8646c7-e525-4741-9dd3-362f7981f89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:51.747552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8646c7-e525-4741-9dd3-362f7981f89d None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:51.747830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8646c7-e525-4741-9dd3-362f7981f89d None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:51.748105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8646c7-e525-4741-9dd3-362f7981f89d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:51.758233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8646c7-e525-4741-9dd3-362f7981f89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-1f8646c7-e525-4741-9dd3-362f7981f89d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:51.763185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:51.764272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:51.765298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 587/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:07:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:51.770379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d1bb0-a9a6-4d9d-89a9-4e427f819f25 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:51.869170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d1bb0-a9a6-4d9d-89a9-4e427f819f25 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:51.904026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97750e83-6fc3-46cc-a4b4-5727b5056989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:51.904628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97750e83-6fc3-46cc-a4b4-5727b5056989 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:51.904902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97750e83-6fc3-46cc-a4b4-5727b5056989 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:51.905172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97750e83-6fc3-46cc-a4b4-5727b5056989 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:51.905871 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97750e83-6fc3-46cc-a4b4-5727b5056989 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:51.906167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97750e83-6fc3-46cc-a4b4-5727b5056989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:51.907549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97750e83-6fc3-46cc-a4b4-5727b5056989 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:51.915451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 563/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:51.922186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8646c7-e525-4741-9dd3-362f7981f89d None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:51.933596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:52.019634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8646c7-e525-4741-9dd3-362f7981f89d None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:52.052589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83158099-3d88-4980-914b-431b973f5013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:52.053206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83158099-3d88-4980-914b-431b973f5013 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:52.053481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83158099-3d88-4980-914b-431b973f5013 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:52.053749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83158099-3d88-4980-914b-431b973f5013 None admin] PATH_INFO: `/v3/users/76abdc5b3fcb4e88af13ddcffa4aeb8f` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:52.054918 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83158099-3d88-4980-914b-431b973f5013 None admin] RBAC: Authorizing `identity:get_user(user_id=76abdc5b3fcb4e88af13ddcffa4aeb8f)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:52.056379 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83158099-3d88-4980-914b-431b973f5013 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:52.058052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 588/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:51 2022] GET /identity/v3/users/76abdc5b3fcb4e88af13ddcffa4aeb8f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:52.063936 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97750e83-6fc3-46cc-a4b4-5727b5056989 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:52.098935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:52.164529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97750e83-6fc3-46cc-a4b4-5727b5056989 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:52.203201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007f46-3a7d-4509-a489-f39a15d00d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:52.203829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007f46-3a7d-4509-a489-f39a15d00d02 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:52.204105 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007f46-3a7d-4509-a489-f39a15d00d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:52.204375 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007f46-3a7d-4509-a489-f39a15d00d02 None admin] PATH_INFO: `/v3/projects/37bb7f7b77a84316af3ae990864f7da3` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:52.205508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007f46-3a7d-4509-a489-f39a15d00d02 None admin] RBAC: Authorizing `identity:get_project(project_id=37bb7f7b77a84316af3ae990864f7da3)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:52.206999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007f46-3a7d-4509-a489-f39a15d00d02 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:52.208670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 564/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:07:52 2022] GET /identity/v3/projects/37bb7f7b77a84316af3ae990864f7da3 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:52.215313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83158099-3d88-4980-914b-431b973f5013 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:52.291279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:52.314028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83158099-3d88-4980-914b-431b973f5013 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:52.348646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475da42-e468-4d39-bbb9-29d330f09574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:52.349290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475da42-e468-4d39-bbb9-29d330f09574 None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:52.349562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475da42-e468-4d39-bbb9-29d330f09574 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:52.349825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475da42-e468-4d39-bbb9-29d330f09574 None admin] PATH_INFO: `/v3/projects/37bb7f7b77a84316af3ae990864f7da3/users/76abdc5b3fcb4e88af13ddcffa4aeb8f/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:52.351778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475da42-e468-4d39-bbb9-29d330f09574 None admin] RBAC: Authorizing `identity:create_grant(project_id=37bb7f7b77a84316af3ae990864f7da3, user_id=76abdc5b3fcb4e88af13ddcffa4aeb8f, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:52.353171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475da42-e468-4d39-bbb9-29d330f09574 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:52.459348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 589/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:07:52 2022] PUT /identity/v3/projects/37bb7f7b77a84316af3ae990864f7da3/users/76abdc5b3fcb4e88af13ddcffa4aeb8f/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:07:54.455628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531ddc-60c9-47cc-9024-ed3fa0c1dabc None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:54.456135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531ddc-60c9-47cc-9024-ed3fa0c1dabc None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:54.456135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531ddc-60c9-47cc-9024-ed3fa0c1dabc None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:54.457461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 565/1154] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:54.462552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eebc2-8db3-475a-b30c-7466e067c1b0 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:54.462992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eebc2-8db3-475a-b30c-7466e067c1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:54.463088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eebc2-8db3-475a-b30c-7466e067c1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:54.481316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a78eebc2-8db3-475a-b30c-7466e067c1b0 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:54.482519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a78eebc2-8db3-475a-b30c-7466e067c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:54.548436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 590/1155] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:54.572208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531ddc-60c9-47cc-9024-ed3fa0c1dabc None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:54.675134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531ddc-60c9-47cc-9024-ed3fa0c1dabc None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:54.676638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:54.710039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6896a7-3568-4a1e-9c45-7eb187671ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:54.710579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6896a7-3568-4a1e-9c45-7eb187671ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:54.710859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6896a7-3568-4a1e-9c45-7eb187671ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:54.711130 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6896a7-3568-4a1e-9c45-7eb187671ea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:54.721473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6896a7-3568-4a1e-9c45-7eb187671ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-ac6896a7-3568-4a1e-9c45-7eb187671ea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:07:54.727034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:54.733729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:07:54.734834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 566/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:54.735698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78eebc2-8db3-475a-b30c-7466e067c1b0 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:54.799901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:54.834512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78eebc2-8db3-475a-b30c-7466e067c1b0 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:54.868039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ff382-72a5-475e-a42b-0bc5d3f139cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:54.868652 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ff382-72a5-475e-a42b-0bc5d3f139cf None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:54.868929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ff382-72a5-475e-a42b-0bc5d3f139cf None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:54.869203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ff382-72a5-475e-a42b-0bc5d3f139cf None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:54.869909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ff382-72a5-475e-a42b-0bc5d3f139cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:54.870884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ff382-72a5-475e-a42b-0bc5d3f139cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:54.872283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ff382-72a5-475e-a42b-0bc5d3f139cf None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:54.880124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 591/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:07:54.886587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6896a7-3568-4a1e-9c45-7eb187671ea6 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:54.983729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6896a7-3568-4a1e-9c45-7eb187671ea6 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:55.016617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2a54d-9b16-43d3-8b40-7fa591712504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:55.017234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2a54d-9b16-43d3-8b40-7fa591712504 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:55.017512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2a54d-9b16-43d3-8b40-7fa591712504 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:55.017783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2a54d-9b16-43d3-8b40-7fa591712504 None admin] PATH_INFO: `/v3/users/76abdc5b3fcb4e88af13ddcffa4aeb8f` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:55.018932 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2a54d-9b16-43d3-8b40-7fa591712504 None admin] RBAC: Authorizing `identity:get_user(user_id=76abdc5b3fcb4e88af13ddcffa4aeb8f)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:55.020346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2a54d-9b16-43d3-8b40-7fa591712504 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:55.021924 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 567/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:07:54 2022] GET /identity/v3/users/76abdc5b3fcb4e88af13ddcffa4aeb8f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:55.028030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ff382-72a5-475e-a42b-0bc5d3f139cf None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:55.124775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ff382-72a5-475e-a42b-0bc5d3f139cf None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:55.149378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:55.156891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250863ef-7216-4f4d-b90a-f4c1fa0dba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:55.157498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250863ef-7216-4f4d-b90a-f4c1fa0dba8e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:55.157772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250863ef-7216-4f4d-b90a-f4c1fa0dba8e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:55.158045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250863ef-7216-4f4d-b90a-f4c1fa0dba8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:55.225156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250863ef-7216-4f4d-b90a-f4c1fa0dba8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:55.226604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250863ef-7216-4f4d-b90a-f4c1fa0dba8e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:55.322161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 592/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:07:55.328312 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2a54d-9b16-43d3-8b40-7fa591712504 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:55.359658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:55.429672 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2a54d-9b16-43d3-8b40-7fa591712504 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:55.463176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0644cd7-a960-4931-9f48-bb16ea141142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:55.463797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0644cd7-a960-4931-9f48-bb16ea141142 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:55.464684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0644cd7-a960-4931-9f48-bb16ea141142 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:55.464963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0644cd7-a960-4931-9f48-bb16ea141142 None admin] PATH_INFO: `/v3/projects/37bb7f7b77a84316af3ae990864f7da3` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:55.466222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0644cd7-a960-4931-9f48-bb16ea141142 None admin] RBAC: Authorizing `identity:get_project(project_id=37bb7f7b77a84316af3ae990864f7da3)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:55.467683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0644cd7-a960-4931-9f48-bb16ea141142 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:55.469373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 568/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:07:55 2022] GET /identity/v3/projects/37bb7f7b77a84316af3ae990864f7da3 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:55.475676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250863ef-7216-4f4d-b90a-f4c1fa0dba8e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:55.503191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:55.571995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250863ef-7216-4f4d-b90a-f4c1fa0dba8e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:55.606803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d0178-461f-4f95-ac75-76ba0576ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:55.607332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d0178-461f-4f95-ac75-76ba0576ed4a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:55.607607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d0178-461f-4f95-ac75-76ba0576ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:55.607872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d0178-461f-4f95-ac75-76ba0576ed4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:55.608644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d0178-461f-4f95-ac75-76ba0576ed4a None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=37bb7f7b77a84316af3ae990864f7da3, user.id=76abdc5b3fcb4e88af13ddcffa4aeb8f) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:55.608943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d0178-461f-4f95-ac75-76ba0576ed4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:55.610410 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d0178-461f-4f95-ac75-76ba0576ed4a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:55.616070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 593/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:07:55 2022] GET /identity/v3/role_assignments?user.id=76abdc5b3fcb4e88af13ddcffa4aeb8f&scope.project.id=37bb7f7b77a84316af3ae990864f7da3&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:07:57.661002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ab29b-a4c7-48bb-bf70-1f24fabd1435 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:57.661557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ab29b-a4c7-48bb-bf70-1f24fabd1435 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:57.661557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ab29b-a4c7-48bb-bf70-1f24fabd1435 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:57.662918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 569/1162] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:07:57.668074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee46dc-e0de-4f52-b8fa-830adfe361a5 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:57.668491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee46dc-e0de-4f52-b8fa-830adfe361a5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:57.668604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee46dc-e0de-4f52-b8fa-830adfe361a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:57.687292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-baee46dc-e0de-4f52-b8fa-830adfe361a5 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:07:57.688454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-baee46dc-e0de-4f52-b8fa-830adfe361a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:07:57.753906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 594/1163] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:07:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:07:57.777194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ab29b-a4c7-48bb-bf70-1f24fabd1435 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:57.873118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:57.877819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ab29b-a4c7-48bb-bf70-1f24fabd1435 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:57.910769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ad9f5-6a20-49b3-9a84-da52421763d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:57.911439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ad9f5-6a20-49b3-9a84-da52421763d0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:57.911873 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ad9f5-6a20-49b3-9a84-da52421763d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:57.912468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ad9f5-6a20-49b3-9a84-da52421763d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:57.979387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ad9f5-6a20-49b3-9a84-da52421763d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:57.981550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ad9f5-6a20-49b3-9a84-da52421763d0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:58.074840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:58.079242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 570/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:07:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:07:58.085329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee46dc-e0de-4f52-b8fa-830adfe361a5 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:58.109394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:07:58.189183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee46dc-e0de-4f52-b8fa-830adfe361a5 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:58.224392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5489e1b-a968-4588-845a-6081a13706cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:58.225024 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489e1b-a968-4588-845a-6081a13706cc None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:58.225323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489e1b-a968-4588-845a-6081a13706cc None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:58.225549 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489e1b-a968-4588-845a-6081a13706cc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:58.233678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5489e1b-a968-4588-845a-6081a13706cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:58.235119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5489e1b-a968-4588-845a-6081a13706cc None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-b5489e1b-a968-4588-845a-6081a13706cc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:07:58.247350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:07:58.248553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:07:58.249399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 595/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 4 05:07:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:07:58.254711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ad9f5-6a20-49b3-9a84-da52421763d0 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:07:58.352829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ad9f5-6a20-49b3-9a84-da52421763d0 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:07:58.386850 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd6244-3a0f-430a-9a9c-7db974a06a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:07:58.387395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6244-3a0f-430a-9a9c-7db974a06a01 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:07:58.387671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6244-3a0f-430a-9a9c-7db974a06a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:07:58.387941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6244-3a0f-430a-9a9c-7db974a06a01 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:07:58.388619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd6244-3a0f-430a-9a9c-7db974a06a01 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:07:58.388920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd6244-3a0f-430a-9a9c-7db974a06a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:07:58.390371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd6244-3a0f-430a-9a9c-7db974a06a01 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:07:58.397433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 571/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Aug 4 05:07:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:00.401163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc9579-0a63-44a4-a1d7-197397e66034 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:00.401776 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc9579-0a63-44a4-a1d7-197397e66034 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:00.401776 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc9579-0a63-44a4-a1d7-197397e66034 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:00.403099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 596/1167] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:08:00.408340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccbe0b-6233-438c-a08f-ec941cb8ec9c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:00.408751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccbe0b-6233-438c-a08f-ec941cb8ec9c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:00.408887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccbe0b-6233-438c-a08f-ec941cb8ec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:00.428166 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9bccbe0b-6233-438c-a08f-ec941cb8ec9c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:08:00.429273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9bccbe0b-6233-438c-a08f-ec941cb8ec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:08:00.485057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:00.495237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 572/1168] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:08:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:08:00.518257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc9579-0a63-44a4-a1d7-197397e66034 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:00.600292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:00.619208 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc9579-0a63-44a4-a1d7-197397e66034 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:00.654270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e31757-3a82-4753-b3c5-a22253472070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:00.654898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31757-3a82-4753-b3c5-a22253472070 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:00.655173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31757-3a82-4753-b3c5-a22253472070 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:00.655447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31757-3a82-4753-b3c5-a22253472070 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:00.656161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e31757-3a82-4753-b3c5-a22253472070 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:00.657510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e31757-3a82-4753-b3c5-a22253472070 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:00.741063 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 597/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Thu Aug 4 05:08:00 2022] POST /identity/v3/domains => generated 267 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:08:02.787342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b16b1-8132-4ed1-a837-48fcc8ffdeed None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:02.787922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b16b1-8132-4ed1-a837-48fcc8ffdeed None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:02.787922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b16b1-8132-4ed1-a837-48fcc8ffdeed None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:02.789244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 573/1170] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:08:02.794631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efaca3-3907-4027-938e-533e571fd099 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:02.795083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efaca3-3907-4027-938e-533e571fd099 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:02.795196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efaca3-3907-4027-938e-533e571fd099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:02.813050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-78efaca3-3907-4027-938e-533e571fd099 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:08:02.814222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-78efaca3-3907-4027-938e-533e571fd099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:08:02.879527 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 598/1171] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:08:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:08:02.904438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b16b1-8132-4ed1-a837-48fcc8ffdeed None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:03.003830 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b16b1-8132-4ed1-a837-48fcc8ffdeed None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:03.037186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adf766-db0a-4a64-b880-c71597a5a410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:03.037856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adf766-db0a-4a64-b880-c71597a5a410 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:03.038081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adf766-db0a-4a64-b880-c71597a5a410 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:03.038378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adf766-db0a-4a64-b880-c71597a5a410 None admin] PATH_INFO: `/v3/domains/17c9c2c711ca43e98c61148b8f78e1b8` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:03.049447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adf766-db0a-4a64-b880-c71597a5a410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=17c9c2c711ca43e98c61148b8f78e1b8)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:03.050921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adf766-db0a-4a64-b880-c71597a5a410 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:03.052506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 574/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Thu Aug 4 05:08:02 2022] GET /identity/v3/domains/17c9c2c711ca43e98c61148b8f78e1b8 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:03.058493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efaca3-3907-4027-938e-533e571fd099 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:03.125905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:03.154783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efaca3-3907-4027-938e-533e571fd099 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:03.189673 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b945-2ac8-4302-a845-7b17f9d158d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:03.190279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b945-2ac8-4302-a845-7b17f9d158d9 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:03.190579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b945-2ac8-4302-a845-7b17f9d158d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:03.190849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b945-2ac8-4302-a845-7b17f9d158d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:03.191525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b945-2ac8-4302-a845-7b17f9d158d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:03.192927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b945-2ac8-4302-a845-7b17f9d158d9 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:03.333190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 599/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:08:03 2022] POST /identity/v3/projects => generated 361 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:08:05.391958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3f89-1066-4f37-8c65-c21d40e3b515 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:05.392499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3f89-1066-4f37-8c65-c21d40e3b515 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:05.392499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3f89-1066-4f37-8c65-c21d40e3b515 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:05.393837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 575/1174] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:08:05.399170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3cf5e-4269-4918-8281-d1cfe7ef244d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:05.399594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3cf5e-4269-4918-8281-d1cfe7ef244d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:05.399721 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3cf5e-4269-4918-8281-d1cfe7ef244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:05.419498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-8be3cf5e-4269-4918-8281-d1cfe7ef244d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:08:05.420603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8be3cf5e-4269-4918-8281-d1cfe7ef244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:08:05.487684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 600/1175] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:08:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:08:05.512564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e3f89-1066-4f37-8c65-c21d40e3b515 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:05.566507 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:05.613827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e3f89-1066-4f37-8c65-c21d40e3b515 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:05.647074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244efcf8-84b7-4fd6-a472-899f686c8d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:05.647708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244efcf8-84b7-4fd6-a472-899f686c8d7e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:05.647983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244efcf8-84b7-4fd6-a472-899f686c8d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:05.648255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244efcf8-84b7-4fd6-a472-899f686c8d7e None admin] PATH_INFO: `/v3/domains/17c9c2c711ca43e98c61148b8f78e1b8` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:05.649398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244efcf8-84b7-4fd6-a472-899f686c8d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=17c9c2c711ca43e98c61148b8f78e1b8)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:05.650856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244efcf8-84b7-4fd6-a472-899f686c8d7e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:05.653148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 576/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Thu Aug 4 05:08:05 2022] GET /identity/v3/domains/17c9c2c711ca43e98c61148b8f78e1b8 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:05.659126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3cf5e-4269-4918-8281-d1cfe7ef244d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:05.712753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:05.757462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3cf5e-4269-4918-8281-d1cfe7ef244d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:05.793081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902554d-afa3-4f83-9776-610c7b42cc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:05.793750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902554d-afa3-4f83-9776-610c7b42cc78 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:05.793985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902554d-afa3-4f83-9776-610c7b42cc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:05.794258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902554d-afa3-4f83-9776-610c7b42cc78 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:05.794960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902554d-afa3-4f83-9776-610c7b42cc78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:05.796378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902554d-afa3-4f83-9776-610c7b42cc78 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:05.904118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 601/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:08:05 2022] POST /identity/v3/users => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:08:07.974679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c066483-b7d4-40ac-a881-bb16f47a451a None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:07.975240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c066483-b7d4-40ac-a881-bb16f47a451a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:07.975240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c066483-b7d4-40ac-a881-bb16f47a451a None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:07.976541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 577/1178] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:08:07.982441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52061-65a8-4463-91e7-da7175596d5f None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:07.982857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52061-65a8-4463-91e7-da7175596d5f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:07.982992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52061-65a8-4463-91e7-da7175596d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:08.001105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c6b52061-65a8-4463-91e7-da7175596d5f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:08:08.002291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c6b52061-65a8-4463-91e7-da7175596d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:08:08.069301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 602/1179] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:08:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:08:08.093750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c066483-b7d4-40ac-a881-bb16f47a451a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:08.194249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c066483-b7d4-40ac-a881-bb16f47a451a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:08.214673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:08.228109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e3023-2fe5-4aa3-a940-f47678fc3e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:08.228678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e3023-2fe5-4aa3-a940-f47678fc3e23 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:08.228952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e3023-2fe5-4aa3-a940-f47678fc3e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:08.229220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e3023-2fe5-4aa3-a940-f47678fc3e23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:08.239224 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e3023-2fe5-4aa3-a940-f47678fc3e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-524e3023-2fe5-4aa3-a940-f47678fc3e23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:08:08.244135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:08:08.245842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:08:08.247363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 578/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:08:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:08:08.252167 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52061-65a8-4463-91e7-da7175596d5f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:08.293655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:08.360650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52061-65a8-4463-91e7-da7175596d5f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:08.395253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976506b-1d4e-43f4-93d3-d6414e00fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:08.395929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976506b-1d4e-43f4-93d3-d6414e00fa4a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:08.396207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976506b-1d4e-43f4-93d3-d6414e00fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:08.396481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976506b-1d4e-43f4-93d3-d6414e00fa4a None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:08.397195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976506b-1d4e-43f4-93d3-d6414e00fa4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:08:08.397498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976506b-1d4e-43f4-93d3-d6414e00fa4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:08.398915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976506b-1d4e-43f4-93d3-d6414e00fa4a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:08.407422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 603/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:08.413237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e3023-2fe5-4aa3-a940-f47678fc3e23 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:08.523256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e3023-2fe5-4aa3-a940-f47678fc3e23 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:08.557147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d8f3f-d514-478e-9a7f-e67f5001099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:08.557866 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d8f3f-d514-478e-9a7f-e67f5001099d None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:08.558268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d8f3f-d514-478e-9a7f-e67f5001099d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:08.558583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d8f3f-d514-478e-9a7f-e67f5001099d None admin] PATH_INFO: `/v3/users/15931de7d7b54a5ba016e27c62fafe63` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:08.571782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d8f3f-d514-478e-9a7f-e67f5001099d None admin] RBAC: Authorizing `identity:get_user(user_id=15931de7d7b54a5ba016e27c62fafe63)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:08.573837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d8f3f-d514-478e-9a7f-e67f5001099d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:08.575642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 579/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:08:08 2022] GET /identity/v3/users/15931de7d7b54a5ba016e27c62fafe63 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:08.581474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976506b-1d4e-43f4-93d3-d6414e00fa4a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:08.679752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976506b-1d4e-43f4-93d3-d6414e00fa4a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:08.681282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:08.715308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4568e31-f1cd-4e58-9fd9-043b57086fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:08.715951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4568e31-f1cd-4e58-9fd9-043b57086fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:08.716223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4568e31-f1cd-4e58-9fd9-043b57086fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:08.716500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4568e31-f1cd-4e58-9fd9-043b57086fb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:08.786084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4568e31-f1cd-4e58-9fd9-043b57086fb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:08.787458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4568e31-f1cd-4e58-9fd9-043b57086fb4 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:08.944646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 604/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:08:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:08:08.951320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d8f3f-d514-478e-9a7f-e67f5001099d None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:08.990865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:09.059826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d8f3f-d514-478e-9a7f-e67f5001099d None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:09.102068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532f95f-618b-43eb-94a8-e0a6acbb025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:09.102747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f95f-618b-43eb-94a8-e0a6acbb025a None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:09.103025 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f95f-618b-43eb-94a8-e0a6acbb025a None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:09.103300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f95f-618b-43eb-94a8-e0a6acbb025a None admin] PATH_INFO: `/v3/projects/38c5bd512be64a3abf11dcff1920ae41` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:09.104580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532f95f-618b-43eb-94a8-e0a6acbb025a None admin] RBAC: Authorizing `identity:get_project(project_id=38c5bd512be64a3abf11dcff1920ae41)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:09.106233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532f95f-618b-43eb-94a8-e0a6acbb025a None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:09.108037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 580/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:08:08 2022] GET /identity/v3/projects/38c5bd512be64a3abf11dcff1920ae41 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:09.114470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4568e31-f1cd-4e58-9fd9-043b57086fb4 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:09.116733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:09.240998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4568e31-f1cd-4e58-9fd9-043b57086fb4 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:09.282543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02473b1-9d71-4eb3-aef1-bd35bd637c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:09.283183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02473b1-9d71-4eb3-aef1-bd35bd637c9f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:09.283459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02473b1-9d71-4eb3-aef1-bd35bd637c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:09.283755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02473b1-9d71-4eb3-aef1-bd35bd637c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:09.284564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02473b1-9d71-4eb3-aef1-bd35bd637c9f None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=38c5bd512be64a3abf11dcff1920ae41, user.id=15931de7d7b54a5ba016e27c62fafe63) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:08:09.284872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02473b1-9d71-4eb3-aef1-bd35bd637c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:09.286909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02473b1-9d71-4eb3-aef1-bd35bd637c9f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:09.298214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 605/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:08:09 2022] GET /identity/v3/role_assignments?user.id=15931de7d7b54a5ba016e27c62fafe63&scope.project.id=38c5bd512be64a3abf11dcff1920ae41&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:11.385179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22de8-1a83-4f56-9052-c38a19b913ed None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:11.385750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22de8-1a83-4f56-9052-c38a19b913ed None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:11.385750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22de8-1a83-4f56-9052-c38a19b913ed None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:11.387156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 581/1186] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:08:11.393220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fd92-c4fe-4444-9640-1d942077755a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:11.393766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fd92-c4fe-4444-9640-1d942077755a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:11.393766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fd92-c4fe-4444-9640-1d942077755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:11.413489 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b109fd92-c4fe-4444-9640-1d942077755a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:08:11.414730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b109fd92-c4fe-4444-9640-1d942077755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:08:11.475382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:11.483242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 606/1187] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:08:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:08:11.505433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df22de8-1a83-4f56-9052-c38a19b913ed None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:11.607299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df22de8-1a83-4f56-9052-c38a19b913ed None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:11.614803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:11.641009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67228e-2239-48ce-b4ae-0d0e1de2f93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:11.641634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67228e-2239-48ce-b4ae-0d0e1de2f93c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:11.641913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67228e-2239-48ce-b4ae-0d0e1de2f93c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:11.642186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67228e-2239-48ce-b4ae-0d0e1de2f93c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:11.653405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67228e-2239-48ce-b4ae-0d0e1de2f93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-0b67228e-2239-48ce-b4ae-0d0e1de2f93c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:08:11.658275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:08:11.659202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:08:11.660176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 582/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:08:11.665577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fd92-c4fe-4444-9640-1d942077755a None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:11.765216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fd92-c4fe-4444-9640-1d942077755a None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:11.799303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aeca25-cf98-49f5-9a97-5cce3efd98b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:11.799910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeca25-cf98-49f5-9a97-5cce3efd98b4 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:11.800185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeca25-cf98-49f5-9a97-5cce3efd98b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:11.800456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeca25-cf98-49f5-9a97-5cce3efd98b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:11.801161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aeca25-cf98-49f5-9a97-5cce3efd98b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:08:11.801460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aeca25-cf98-49f5-9a97-5cce3efd98b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:11.802844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aeca25-cf98-49f5-9a97-5cce3efd98b4 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:11.811975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 607/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:08:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:08:11.817656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67228e-2239-48ce-b4ae-0d0e1de2f93c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:11.917770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67228e-2239-48ce-b4ae-0d0e1de2f93c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:11.952697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabee56-f434-4e8a-ad34-62c7d15e8a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:11.953330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabee56-f434-4e8a-ad34-62c7d15e8a84 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:11.953611 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabee56-f434-4e8a-ad34-62c7d15e8a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:11.953887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabee56-f434-4e8a-ad34-62c7d15e8a84 None admin] PATH_INFO: `/v3/users/15931de7d7b54a5ba016e27c62fafe63` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:11.955078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabee56-f434-4e8a-ad34-62c7d15e8a84 None admin] RBAC: Authorizing `identity:get_user(user_id=15931de7d7b54a5ba016e27c62fafe63)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:11.956512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabee56-f434-4e8a-ad34-62c7d15e8a84 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:11.958119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 583/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:08:11 2022] GET /identity/v3/users/15931de7d7b54a5ba016e27c62fafe63 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:11.963937 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aeca25-cf98-49f5-9a97-5cce3efd98b4 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:12.023091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:12.065595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aeca25-cf98-49f5-9a97-5cce3efd98b4 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:12.099728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1d62-ba79-4d82-886f-18c80c51f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:12.100358 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1d62-ba79-4d82-886f-18c80c51f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:12.100628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1d62-ba79-4d82-886f-18c80c51f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:12.100893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1d62-ba79-4d82-886f-18c80c51f8b8 None admin] PATH_INFO: `/v3/projects/38c5bd512be64a3abf11dcff1920ae41` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:12.102021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1d62-ba79-4d82-886f-18c80c51f8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=38c5bd512be64a3abf11dcff1920ae41)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:12.103505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1d62-ba79-4d82-886f-18c80c51f8b8 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:12.105258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 608/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:08:11 2022] GET /identity/v3/projects/38c5bd512be64a3abf11dcff1920ae41 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:12.111513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabee56-f434-4e8a-ad34-62c7d15e8a84 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:12.150468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:12.220538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabee56-f434-4e8a-ad34-62c7d15e8a84 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:12.256296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d750c01-eef3-4764-aa13-c20d6031026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:12.257403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d750c01-eef3-4764-aa13-c20d6031026d None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:12.257904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d750c01-eef3-4764-aa13-c20d6031026d None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:12.258414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d750c01-eef3-4764-aa13-c20d6031026d None admin] PATH_INFO: `/v3/projects/38c5bd512be64a3abf11dcff1920ae41/users/15931de7d7b54a5ba016e27c62fafe63/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:12.260729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d750c01-eef3-4764-aa13-c20d6031026d None admin] RBAC: Authorizing `identity:create_grant(project_id=38c5bd512be64a3abf11dcff1920ae41, user_id=15931de7d7b54a5ba016e27c62fafe63, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:12.262763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d750c01-eef3-4764-aa13-c20d6031026d None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:12.343911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 584/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:08:12 2022] PUT /identity/v3/projects/38c5bd512be64a3abf11dcff1920ae41/users/15931de7d7b54a5ba016e27c62fafe63/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:08:14.353774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a6ae-7e7e-426a-b3f6-83233b0696cb None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:14.354486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a6ae-7e7e-426a-b3f6-83233b0696cb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:14.354486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a6ae-7e7e-426a-b3f6-83233b0696cb None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:14.356444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 609/1193] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:08:14.363322 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcb45a-df2b-4b94-99c1-333c96b5be5c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:14.363881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcb45a-df2b-4b94-99c1-333c96b5be5c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:14.363881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcb45a-df2b-4b94-99c1-333c96b5be5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:14.383768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-effcb45a-df2b-4b94-99c1-333c96b5be5c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:08:14.384974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-effcb45a-df2b-4b94-99c1-333c96b5be5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:08:14.456857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 585/1194] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:08:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:08:14.481292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a6ae-7e7e-426a-b3f6-83233b0696cb None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:14.597824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a6ae-7e7e-426a-b3f6-83233b0696cb None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:14.624027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:14.639656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91953eb3-9404-4f0b-bfa6-52faaa5c3246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:14.640411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91953eb3-9404-4f0b-bfa6-52faaa5c3246 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:14.640793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91953eb3-9404-4f0b-bfa6-52faaa5c3246 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:14.641154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91953eb3-9404-4f0b-bfa6-52faaa5c3246 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:14.653110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91953eb3-9404-4f0b-bfa6-52faaa5c3246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-91953eb3-9404-4f0b-bfa6-52faaa5c3246 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:08:14.658030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:08:14.659138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:08:14.659996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:08:14.662539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 610/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:08:14.665643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcb45a-df2b-4b94-99c1-333c96b5be5c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:14.691567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:14.773094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcb45a-df2b-4b94-99c1-333c96b5be5c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:14.807149 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47879-1391-4f6b-bb19-2e964369e64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:14.807899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47879-1391-4f6b-bb19-2e964369e64c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:14.808429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47879-1391-4f6b-bb19-2e964369e64c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:14.808429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47879-1391-4f6b-bb19-2e964369e64c None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:14.808992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af47879-1391-4f6b-bb19-2e964369e64c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:08:14.809291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af47879-1391-4f6b-bb19-2e964369e64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:14.810676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af47879-1391-4f6b-bb19-2e964369e64c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:14.818832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 586/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:08:14.825405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91953eb3-9404-4f0b-bfa6-52faaa5c3246 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:14.936885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91953eb3-9404-4f0b-bfa6-52faaa5c3246 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:14.972179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529b1c2-a55a-4464-9ede-edf3e9240e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:14.972811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529b1c2-a55a-4464-9ede-edf3e9240e52 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:14.973088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529b1c2-a55a-4464-9ede-edf3e9240e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:14.973359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529b1c2-a55a-4464-9ede-edf3e9240e52 None admin] PATH_INFO: `/v3/users/15931de7d7b54a5ba016e27c62fafe63` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:14.974547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529b1c2-a55a-4464-9ede-edf3e9240e52 None admin] RBAC: Authorizing `identity:get_user(user_id=15931de7d7b54a5ba016e27c62fafe63)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:14.975989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529b1c2-a55a-4464-9ede-edf3e9240e52 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:14.977613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 611/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Aug 4 05:08:14 2022] GET /identity/v3/users/15931de7d7b54a5ba016e27c62fafe63 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:14.984366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47879-1391-4f6b-bb19-2e964369e64c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:15.082173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:15.097650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47879-1391-4f6b-bb19-2e964369e64c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:15.133954 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd5e0b-038b-4102-902c-ab9919cc4a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:15.134611 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd5e0b-038b-4102-902c-ab9919cc4a81 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:15.134891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd5e0b-038b-4102-902c-ab9919cc4a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:15.135159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd5e0b-038b-4102-902c-ab9919cc4a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:15.205685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd5e0b-038b-4102-902c-ab9919cc4a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:15.207164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd5e0b-038b-4102-902c-ab9919cc4a81 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:15.296602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:15.312973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 587/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:08:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:08:15.319102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529b1c2-a55a-4464-9ede-edf3e9240e52 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:15.376692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:15.421143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529b1c2-a55a-4464-9ede-edf3e9240e52 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:15.454805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f1bd4-3825-4823-9393-d492b8d78ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:15.455439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1bd4-3825-4823-9393-d492b8d78ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:15.455715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1bd4-3825-4823-9393-d492b8d78ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:15.455985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1bd4-3825-4823-9393-d492b8d78ef7 None admin] PATH_INFO: `/v3/projects/38c5bd512be64a3abf11dcff1920ae41` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:15.457127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f1bd4-3825-4823-9393-d492b8d78ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=38c5bd512be64a3abf11dcff1920ae41)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:15.458569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f1bd4-3825-4823-9393-d492b8d78ef7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:15.460231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 612/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Aug 4 05:08:15 2022] GET /identity/v3/projects/38c5bd512be64a3abf11dcff1920ae41 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:15.466734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd5e0b-038b-4102-902c-ab9919cc4a81 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:15.570113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd5e0b-038b-4102-902c-ab9919cc4a81 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:15.606066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9951e-9b86-461b-953e-4ae7cb206864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:15.606717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9951e-9b86-461b-953e-4ae7cb206864 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:15.606999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9951e-9b86-461b-953e-4ae7cb206864 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:15.607271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9951e-9b86-461b-953e-4ae7cb206864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:15.608055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9951e-9b86-461b-953e-4ae7cb206864 None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=38c5bd512be64a3abf11dcff1920ae41, user.id=15931de7d7b54a5ba016e27c62fafe63) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:08:15.608361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9951e-9b86-461b-953e-4ae7cb206864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:15.609778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9951e-9b86-461b-953e-4ae7cb206864 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:15.615600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 588/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:08:15 2022] GET /identity/v3/role_assignments?user.id=15931de7d7b54a5ba016e27c62fafe63&scope.project.id=38c5bd512be64a3abf11dcff1920ae41&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:08:25.450618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=39 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:25.612927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=75 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:30.774608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880d1e-a3ee-4f92-8b09-152236e64779 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:30.775211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880d1e-a3ee-4f92-8b09-152236e64779 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:30.775211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880d1e-a3ee-4f92-8b09-152236e64779 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:30.777022 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 613/1201] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:30.782969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41943-c68d-4dad-9303-af7b72998a18 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:30.783494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41943-c68d-4dad-9303-af7b72998a18 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:30.783494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41943-c68d-4dad-9303-af7b72998a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:30.803364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-65b41943-c68d-4dad-9303-af7b72998a18 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:30.804585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-65b41943-c68d-4dad-9303-af7b72998a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:30.875461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 589/1202] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:09:30.900447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05880d1e-a3ee-4f92-8b09-152236e64779 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:31.009279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05880d1e-a3ee-4f92-8b09-152236e64779 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:31.045428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132b51-ecf6-43c7-a9ef-fe8539b61206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:31.046019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132b51-ecf6-43c7-a9ef-fe8539b61206 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:31.046296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132b51-ecf6-43c7-a9ef-fe8539b61206 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:31.046602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132b51-ecf6-43c7-a9ef-fe8539b61206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:31.058254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132b51-ecf6-43c7-a9ef-fe8539b61206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:31.062373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132b51-ecf6-43c7-a9ef-fe8539b61206 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-7c132b51-ecf6-43c7-a9ef-fe8539b61206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:31.076613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:31.077860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:31.078871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:31.078871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:31.078871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:31.078871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:31.078871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 614/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:31.087337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41943-c68d-4dad-9303-af7b72998a18 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:31.198207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41943-c68d-4dad-9303-af7b72998a18 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:31.237245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:31.243525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9cef-bd6b-4e32-bf06-772dce970f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:31.244322 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9cef-bd6b-4e32-bf06-772dce970f53 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:31.244691 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9cef-bd6b-4e32-bf06-772dce970f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:31.245060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9cef-bd6b-4e32-bf06-772dce970f53 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:31.246514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b9cef-bd6b-4e32-bf06-772dce970f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:31.246920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b9cef-bd6b-4e32-bf06-772dce970f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:31.248455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b9cef-bd6b-4e32-bf06-772dce970f53 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:31.260555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 590/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:31.268296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132b51-ecf6-43c7-a9ef-fe8539b61206 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:31.333383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:31.413477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132b51-ecf6-43c7-a9ef-fe8539b61206 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:31.471769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ed5d1-fe32-410b-bc90-5f7189f707a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:31.472803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ed5d1-fe32-410b-bc90-5f7189f707a5 None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:31.473295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ed5d1-fe32-410b-bc90-5f7189f707a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:31.473792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ed5d1-fe32-410b-bc90-5f7189f707a5 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:31.475147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ed5d1-fe32-410b-bc90-5f7189f707a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:31.477611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ed5d1-fe32-410b-bc90-5f7189f707a5 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:31.581214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 615/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Aug 4 05:09:31 2022] POST /identity/v3/users => generated 251 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:09:33.741283 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3fffa-418a-4379-a91f-d394e102f746 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:33.741921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3fffa-418a-4379-a91f-d394e102f746 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:33.741921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3fffa-418a-4379-a91f-d394e102f746 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:33.743204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 591/1206] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:33.749504 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021dd94-51cf-48b2-b160-39f82823d05b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:33.749955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021dd94-51cf-48b2-b160-39f82823d05b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:33.750064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021dd94-51cf-48b2-b160-39f82823d05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:33.771557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3021dd94-51cf-48b2-b160-39f82823d05b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:33.772764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3021dd94-51cf-48b2-b160-39f82823d05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:33.842773 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 616/1207] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:09:33.867288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3fffa-418a-4379-a91f-d394e102f746 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:33.973390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3fffa-418a-4379-a91f-d394e102f746 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:34.008574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc2517-e9e7-4aa8-8c08-7236207c98c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:34.009133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2517-e9e7-4aa8-8c08-7236207c98c5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:34.009411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2517-e9e7-4aa8-8c08-7236207c98c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:34.009685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2517-e9e7-4aa8-8c08-7236207c98c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:34.020997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc2517-e9e7-4aa8-8c08-7236207c98c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-83dc2517-e9e7-4aa8-8c08-7236207c98c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:09:34.025875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:34.027845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:34.028886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 592/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:09:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:09:34.034191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021dd94-51cf-48b2-b160-39f82823d05b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:34.075802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:34.135579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021dd94-51cf-48b2-b160-39f82823d05b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:34.173329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2504b8-2f00-44df-a563-e71c236d61f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:34.173953 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2504b8-2f00-44df-a563-e71c236d61f6 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:34.174224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2504b8-2f00-44df-a563-e71c236d61f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:34.174521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2504b8-2f00-44df-a563-e71c236d61f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:34.175267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2504b8-2f00-44df-a563-e71c236d61f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:34.175625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2504b8-2f00-44df-a563-e71c236d61f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:34.177021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2504b8-2f00-44df-a563-e71c236d61f6 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:34.186742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 617/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:09:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:09:34.192559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc2517-e9e7-4aa8-8c08-7236207c98c5 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:34.249285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:34.303112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc2517-e9e7-4aa8-8c08-7236207c98c5 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:34.337409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab1ac6-bc54-42d3-91ad-d12eb35d0219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:34.338045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab1ac6-bc54-42d3-91ad-d12eb35d0219 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:34.338355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab1ac6-bc54-42d3-91ad-d12eb35d0219 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:34.338636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab1ac6-bc54-42d3-91ad-d12eb35d0219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:34.351005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab1ac6-bc54-42d3-91ad-d12eb35d0219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:34.354325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab1ac6-bc54-42d3-91ad-d12eb35d0219 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-33ab1ac6-bc54-42d3-91ad-d12eb35d0219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:34.367469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:34.368607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:34.369543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:34.369543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:34.369543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:34.369543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:34.369543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 593/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:09:34.375091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2504b8-2f00-44df-a563-e71c236d61f6 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:34.472455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:34.475613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2504b8-2f00-44df-a563-e71c236d61f6 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:34.513312 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232aef8-b1d4-4c29-9c55-aeb2a9489df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:34.513928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232aef8-b1d4-4c29-9c55-aeb2a9489df7 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:34.514203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232aef8-b1d4-4c29-9c55-aeb2a9489df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:34.514502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232aef8-b1d4-4c29-9c55-aeb2a9489df7 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:34.515191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232aef8-b1d4-4c29-9c55-aeb2a9489df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:34.515492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232aef8-b1d4-4c29-9c55-aeb2a9489df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:34.516835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232aef8-b1d4-4c29-9c55-aeb2a9489df7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:34.528706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 618/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:34.535028 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab1ac6-bc54-42d3-91ad-d12eb35d0219 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:34.643138 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab1ac6-bc54-42d3-91ad-d12eb35d0219 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:34.644925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:34.683225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7324019-776c-4c71-a72c-fd3f5ede095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:34.683806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7324019-776c-4c71-a72c-fd3f5ede095f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:34.683984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7324019-776c-4c71-a72c-fd3f5ede095f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:34.684259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7324019-776c-4c71-a72c-fd3f5ede095f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:34.693016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7324019-776c-4c71-a72c-fd3f5ede095f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:34.694521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7324019-776c-4c71-a72c-fd3f5ede095f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-f7324019-776c-4c71-a72c-fd3f5ede095f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:09:34.709511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:34.714739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:34.715824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 594/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:34.716683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232aef8-b1d4-4c29-9c55-aeb2a9489df7 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:34.826082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232aef8-b1d4-4c29-9c55-aeb2a9489df7 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:34.859841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958bfe-437f-4fda-a00a-115f8b1209e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:34.860453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958bfe-437f-4fda-a00a-115f8b1209e0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:34.860726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958bfe-437f-4fda-a00a-115f8b1209e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:34.860991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958bfe-437f-4fda-a00a-115f8b1209e0 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:34.861773 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958bfe-437f-4fda-a00a-115f8b1209e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:34.862072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958bfe-437f-4fda-a00a-115f8b1209e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:34.863543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958bfe-437f-4fda-a00a-115f8b1209e0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:34.881843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 619/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 4 05:09:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:09:34.888988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7324019-776c-4c71-a72c-fd3f5ede095f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:34.991804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7324019-776c-4c71-a72c-fd3f5ede095f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:35.027485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec80e-9c08-4152-ab9c-a4a9084650cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:35.028099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec80e-9c08-4152-ab9c-a4a9084650cd None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:35.028378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec80e-9c08-4152-ab9c-a4a9084650cd None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:35.028646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec80e-9c08-4152-ab9c-a4a9084650cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:35.060088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:35.099068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec80e-9c08-4152-ab9c-a4a9084650cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:35.100532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec80e-9c08-4152-ab9c-a4a9084650cd None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:35.204710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 595/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:09:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:09:35.211012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958bfe-437f-4fda-a00a-115f8b1209e0 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:35.231359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:35.316129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958bfe-437f-4fda-a00a-115f8b1209e0 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:35.351180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ea704-286e-4ade-9b76-84bf9fafbf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:35.351808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ea704-286e-4ade-9b76-84bf9fafbf60 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:35.352080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ea704-286e-4ade-9b76-84bf9fafbf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:35.352346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ea704-286e-4ade-9b76-84bf9fafbf60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:35.364217 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ea704-286e-4ade-9b76-84bf9fafbf60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:35.365654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ea704-286e-4ade-9b76-84bf9fafbf60 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-a48ea704-286e-4ade-9b76-84bf9fafbf60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:35.381615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:35.384984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:35.386759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:35.386759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:35.386759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:35.386759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:35.386759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 620/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:35.389089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec80e-9c08-4152-ab9c-a4a9084650cd None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:35.451554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:35.495458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec80e-9c08-4152-ab9c-a4a9084650cd None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:35.529997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83858a9e-05ad-410d-86a8-00a9798f3546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:35.530641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83858a9e-05ad-410d-86a8-00a9798f3546 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:35.530918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83858a9e-05ad-410d-86a8-00a9798f3546 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:35.531194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83858a9e-05ad-410d-86a8-00a9798f3546 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:35.531884 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83858a9e-05ad-410d-86a8-00a9798f3546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:35.532183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83858a9e-05ad-410d-86a8-00a9798f3546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:35.533543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83858a9e-05ad-410d-86a8-00a9798f3546 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:35.548189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 596/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:35.553981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ea704-286e-4ade-9b76-84bf9fafbf60 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:35.628743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:35.662055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ea704-286e-4ade-9b76-84bf9fafbf60 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:35.701121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a71a1d-588a-4160-9608-be8350319c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:35.701765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a71a1d-588a-4160-9608-be8350319c8e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:35.702032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a71a1d-588a-4160-9608-be8350319c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:35.702327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a71a1d-588a-4160-9608-be8350319c8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:35.709412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a71a1d-588a-4160-9608-be8350319c8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:35.710906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a71a1d-588a-4160-9608-be8350319c8e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-68a71a1d-588a-4160-9608-be8350319c8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:09:35.723922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:35.725576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:35.727615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:09:35.727615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:09:35.727615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:09:35.727615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:09:35.727615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:09:35.727615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:09:35.727615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:35.727615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:35.730265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 621/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:09:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:35.731459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83858a9e-05ad-410d-86a8-00a9798f3546 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:35.843075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83858a9e-05ad-410d-86a8-00a9798f3546 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:35.867343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:35.880224 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ff3c9-0498-433f-8929-e83b39a08ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:35.880831 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ff3c9-0498-433f-8929-e83b39a08ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:35.881157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ff3c9-0498-433f-8929-e83b39a08ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:35.881493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ff3c9-0498-433f-8929-e83b39a08ee5 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:35.882337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ff3c9-0498-433f-8929-e83b39a08ee5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:35.882679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ff3c9-0498-433f-8929-e83b39a08ee5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:35.884173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ff3c9-0498-433f-8929-e83b39a08ee5 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:35.897041 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 597/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:09:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:35.907220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a71a1d-588a-4160-9608-be8350319c8e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:36.022287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a71a1d-588a-4160-9608-be8350319c8e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:36.053141 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:36.059735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e8bf7-29f6-455a-b890-abbabd7dfad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:36.060370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8bf7-29f6-455a-b890-abbabd7dfad0 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:36.060648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8bf7-29f6-455a-b890-abbabd7dfad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:36.060975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8bf7-29f6-455a-b890-abbabd7dfad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:36.061792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e8bf7-29f6-455a-b890-abbabd7dfad0 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=448d43be14a74865a1e0d09e76c7e248) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:36.062097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e8bf7-29f6-455a-b890-abbabd7dfad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:36.063562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e8bf7-29f6-455a-b890-abbabd7dfad0 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:36.069200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 622/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:09:35 2022] GET /identity/v3/role_assignments?user.id=448d43be14a74865a1e0d09e76c7e248&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:38.131363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b6709-559c-4394-96a8-ff8412c7e042 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:38.131921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b6709-559c-4394-96a8-ff8412c7e042 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:38.131921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b6709-559c-4394-96a8-ff8412c7e042 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:38.133261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 598/1220] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:38.139630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e3d52-f267-4fd7-8707-9a7387a2b46c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:38.140116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e3d52-f267-4fd7-8707-9a7387a2b46c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:38.140216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e3d52-f267-4fd7-8707-9a7387a2b46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:38.158996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a82e3d52-f267-4fd7-8707-9a7387a2b46c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:38.160240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a82e3d52-f267-4fd7-8707-9a7387a2b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:38.229823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 623/1221] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:09:38.253643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b6709-559c-4394-96a8-ff8412c7e042 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:38.363962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b6709-559c-4394-96a8-ff8412c7e042 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:38.405847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117ef7-a6df-486e-8cb2-1190c576368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:38.406422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117ef7-a6df-486e-8cb2-1190c576368b None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:38.406700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117ef7-a6df-486e-8cb2-1190c576368b None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:38.407006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117ef7-a6df-486e-8cb2-1190c576368b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:38.419864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff117ef7-a6df-486e-8cb2-1190c576368b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-ff117ef7-a6df-486e-8cb2-1190c576368b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:09:38.425533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:38.429385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:38.430255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 599/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:09:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:38.433756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e3d52-f267-4fd7-8707-9a7387a2b46c None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:38.553589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e3d52-f267-4fd7-8707-9a7387a2b46c None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:38.580886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:38.593056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46741983-0976-4390-9a80-f381c308b1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:38.593683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46741983-0976-4390-9a80-f381c308b1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:38.593958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46741983-0976-4390-9a80-f381c308b1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:38.594281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46741983-0976-4390-9a80-f381c308b1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:38.595027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46741983-0976-4390-9a80-f381c308b1a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:38.595332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46741983-0976-4390-9a80-f381c308b1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:38.596692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46741983-0976-4390-9a80-f381c308b1a1 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:38.606163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 624/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:09:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:38.613661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117ef7-a6df-486e-8cb2-1190c576368b None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:38.663319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:38.724135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117ef7-a6df-486e-8cb2-1190c576368b None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:38.759667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3bbc-e8f4-425f-9aad-27bf22a005bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:38.760350 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3bbc-e8f4-425f-9aad-27bf22a005bc None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:38.761203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3bbc-e8f4-425f-9aad-27bf22a005bc None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:38.761479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3bbc-e8f4-425f-9aad-27bf22a005bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:38.772142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3bbc-e8f4-425f-9aad-27bf22a005bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:38.773675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3bbc-e8f4-425f-9aad-27bf22a005bc None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-132f3bbc-e8f4-425f-9aad-27bf22a005bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:38.790451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:38.799999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:38.800929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:38.800929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:38.800929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:38.800929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:38.800929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 600/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:38.801222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46741983-0976-4390-9a80-f381c308b1a1 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:38.909120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46741983-0976-4390-9a80-f381c308b1a1 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:38.945113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35600358-c439-4b84-beff-ca8aee2700b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:38.945635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35600358-c439-4b84-beff-ca8aee2700b7 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:38.945908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35600358-c439-4b84-beff-ca8aee2700b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:38.946174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35600358-c439-4b84-beff-ca8aee2700b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:38.946888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35600358-c439-4b84-beff-ca8aee2700b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:38.947191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35600358-c439-4b84-beff-ca8aee2700b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:38.949756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35600358-c439-4b84-beff-ca8aee2700b7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:38.963559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 625/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:38.969553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3bbc-e8f4-425f-9aad-27bf22a005bc None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:39.072731 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:39.080556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3bbc-e8f4-425f-9aad-27bf22a005bc None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:39.120433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf83b50-6f65-46bb-9276-c28956d0aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:39.121049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf83b50-6f65-46bb-9276-c28956d0aef0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:39.121327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf83b50-6f65-46bb-9276-c28956d0aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:39.121597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf83b50-6f65-46bb-9276-c28956d0aef0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:39.129669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf83b50-6f65-46bb-9276-c28956d0aef0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:39.131222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf83b50-6f65-46bb-9276-c28956d0aef0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-5bf83b50-6f65-46bb-9276-c28956d0aef0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:09:39.144527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:39.149446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:39.150778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 601/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:39.153148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35600358-c439-4b84-beff-ca8aee2700b7 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:39.205025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:39.259365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35600358-c439-4b84-beff-ca8aee2700b7 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:39.294977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51207c06-1f78-49ea-b0f1-3e4d7ec68099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:39.295596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51207c06-1f78-49ea-b0f1-3e4d7ec68099 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:39.295872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51207c06-1f78-49ea-b0f1-3e4d7ec68099 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:39.296142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51207c06-1f78-49ea-b0f1-3e4d7ec68099 None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:39.297205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51207c06-1f78-49ea-b0f1-3e4d7ec68099 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:39.297502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51207c06-1f78-49ea-b0f1-3e4d7ec68099 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:39.299051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51207c06-1f78-49ea-b0f1-3e4d7ec68099 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:39.318862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 626/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 4 05:09:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:39.325917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf83b50-6f65-46bb-9276-c28956d0aef0 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:39.430835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf83b50-6f65-46bb-9276-c28956d0aef0 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:39.468260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3d8f7-e997-47dc-8d7d-305410fa7ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:39.468813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3d8f7-e997-47dc-8d7d-305410fa7ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:39.469090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3d8f7-e997-47dc-8d7d-305410fa7ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:39.469360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3d8f7-e997-47dc-8d7d-305410fa7ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:39.481019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3d8f7-e997-47dc-8d7d-305410fa7ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:39.482508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3d8f7-e997-47dc-8d7d-305410fa7ac8 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-d4a3d8f7-e997-47dc-8d7d-305410fa7ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:39.497546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:39.498762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:39.500068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:39.500068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:39.500068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:39.500068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:39.500068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 602/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:39.505029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51207c06-1f78-49ea-b0f1-3e4d7ec68099 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:39.607824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51207c06-1f78-49ea-b0f1-3e4d7ec68099 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:39.610275 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:39.644175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68896275-4ba7-4a92-98e9-4c2dc84a5fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:39.644785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68896275-4ba7-4a92-98e9-4c2dc84a5fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:39.645058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68896275-4ba7-4a92-98e9-4c2dc84a5fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:39.645328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68896275-4ba7-4a92-98e9-4c2dc84a5fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:39.646007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68896275-4ba7-4a92-98e9-4c2dc84a5fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:39.646298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68896275-4ba7-4a92-98e9-4c2dc84a5fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:39.647671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68896275-4ba7-4a92-98e9-4c2dc84a5fd3 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:39.659979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 627/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:09:39.665748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3d8f7-e997-47dc-8d7d-305410fa7ac8 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:39.675842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:39.769887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3d8f7-e997-47dc-8d7d-305410fa7ac8 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:39.804689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329c62-4d64-453d-ab53-4b70e49f2944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:39.805344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329c62-4d64-453d-ab53-4b70e49f2944 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:39.805617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329c62-4d64-453d-ab53-4b70e49f2944 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:39.805892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329c62-4d64-453d-ab53-4b70e49f2944 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:39.814420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05329c62-4d64-453d-ab53-4b70e49f2944 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:39.815880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05329c62-4d64-453d-ab53-4b70e49f2944 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-05329c62-4d64-453d-ab53-4b70e49f2944 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:09:39.828655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:39.830455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:39.832557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:09:39.832557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:09:39.832557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:09:39.832557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:09:39.832557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:09:39.832557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:09:39.832557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:39.832557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:39.832557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 603/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:09:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:39.837576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68896275-4ba7-4a92-98e9-4c2dc84a5fd3 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:39.937613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68896275-4ba7-4a92-98e9-4c2dc84a5fd3 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:39.973058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1e41e-a570-4f45-99fc-44a28cf1846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:39.973657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1e41e-a570-4f45-99fc-44a28cf1846b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:39.973929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1e41e-a570-4f45-99fc-44a28cf1846b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:39.974193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1e41e-a570-4f45-99fc-44a28cf1846b None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:39.975036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1e41e-a570-4f45-99fc-44a28cf1846b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:39.975334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1e41e-a570-4f45-99fc-44a28cf1846b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:39.976744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1e41e-a570-4f45-99fc-44a28cf1846b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:39.992132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 628/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:09:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:39.998519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329c62-4d64-453d-ab53-4b70e49f2944 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:40.071479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:40.107333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329c62-4d64-453d-ab53-4b70e49f2944 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:40.142333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f0fc7-36fe-470b-8eed-560ddd129561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:40.143024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f0fc7-36fe-470b-8eed-560ddd129561 None admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:40.143306 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f0fc7-36fe-470b-8eed-560ddd129561 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:40.143584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f0fc7-36fe-470b-8eed-560ddd129561 None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/448d43be14a74865a1e0d09e76c7e248/roles/16ee851075b24775bcb2377722b5adb4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:40.160512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f0fc7-36fe-470b-8eed-560ddd129561 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=448d43be14a74865a1e0d09e76c7e248, role_id=16ee851075b24775bcb2377722b5adb4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:40.161973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f0fc7-36fe-470b-8eed-560ddd129561 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:40.349605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 604/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:09:39 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/448d43be14a74865a1e0d09e76c7e248/roles/16ee851075b24775bcb2377722b5adb4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:09:42.457216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f039-1352-446f-8419-4bf8d40f9333 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:42.457799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f039-1352-446f-8419-4bf8d40f9333 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:42.457799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f039-1352-446f-8419-4bf8d40f9333 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:42.459056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 629/1233] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:42.464293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d5131-1bf8-4ce0-a454-8b714ddf0bd6 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:42.464695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d5131-1bf8-4ce0-a454-8b714ddf0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:42.464839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d5131-1bf8-4ce0-a454-8b714ddf0bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:42.483313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-220d5131-1bf8-4ce0-a454-8b714ddf0bd6 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:42.484500 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-220d5131-1bf8-4ce0-a454-8b714ddf0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:42.561344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 605/1234] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:09:42.584992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23f039-1352-446f-8419-4bf8d40f9333 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:42.612241 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:42.694910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23f039-1352-446f-8419-4bf8d40f9333 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:42.731628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e32d-1feb-499d-a7fc-3fb923d47bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:42.732168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e32d-1feb-499d-a7fc-3fb923d47bdc None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:42.732442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e32d-1feb-499d-a7fc-3fb923d47bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:42.732736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e32d-1feb-499d-a7fc-3fb923d47bdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:42.742691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e32d-1feb-499d-a7fc-3fb923d47bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-1915e32d-1feb-499d-a7fc-3fb923d47bdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:09:42.748139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:42.749274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:42.750279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 630/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Aug 4 05:09:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:42.755657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d5131-1bf8-4ce0-a454-8b714ddf0bd6 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:42.802778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:42.864178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d5131-1bf8-4ce0-a454-8b714ddf0bd6 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:42.900670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01453f-3bf5-490e-836f-8393479f6cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:42.902495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01453f-3bf5-490e-836f-8393479f6cbf None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:42.902778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01453f-3bf5-490e-836f-8393479f6cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:42.903049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01453f-3bf5-490e-836f-8393479f6cbf None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:42.903771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01453f-3bf5-490e-836f-8393479f6cbf None admin] RBAC: Adding query filter params (name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:42.904070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01453f-3bf5-490e-836f-8393479f6cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:42.905441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01453f-3bf5-490e-836f-8393479f6cbf None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:42.913752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 606/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Aug 4 05:09:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:42.921566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e32d-1feb-499d-a7fc-3fb923d47bdc None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:43.022768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:43.040180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e32d-1feb-499d-a7fc-3fb923d47bdc None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:43.078124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee535-bec9-4d76-963a-0f42ea63fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:43.078799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee535-bec9-4d76-963a-0f42ea63fe33 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:43.079078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee535-bec9-4d76-963a-0f42ea63fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:43.079350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee535-bec9-4d76-963a-0f42ea63fe33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:43.093645 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ee535-bec9-4d76-963a-0f42ea63fe33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:43.095334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ee535-bec9-4d76-963a-0f42ea63fe33 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-d98ee535-bec9-4d76-963a-0f42ea63fe33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:43.111272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:43.112838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:43.114741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:43.114741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:43.114741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:43.114741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:43.114741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 631/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:43.118502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01453f-3bf5-490e-836f-8393479f6cbf None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:43.231418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01453f-3bf5-490e-836f-8393479f6cbf None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:43.241181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:43.267928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efdc0b-4882-445b-b84d-f003d69894d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:43.268587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efdc0b-4882-445b-b84d-f003d69894d9 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:43.268860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efdc0b-4882-445b-b84d-f003d69894d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:43.269148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efdc0b-4882-445b-b84d-f003d69894d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:43.269821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efdc0b-4882-445b-b84d-f003d69894d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:43.270120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efdc0b-4882-445b-b84d-f003d69894d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:43.271528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efdc0b-4882-445b-b84d-f003d69894d9 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:43.284991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 607/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:09:43.290753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee535-bec9-4d76-963a-0f42ea63fe33 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:43.403833 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee535-bec9-4d76-963a-0f42ea63fe33 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:43.440367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4741da5-830b-4d0d-ab8c-101bb9cdeee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:43.441015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4741da5-830b-4d0d-ab8c-101bb9cdeee4 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:43.441289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4741da5-830b-4d0d-ab8c-101bb9cdeee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:43.441557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4741da5-830b-4d0d-ab8c-101bb9cdeee4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:43.444449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:43.450369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4741da5-830b-4d0d-ab8c-101bb9cdeee4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:43.451815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4741da5-830b-4d0d-ab8c-101bb9cdeee4 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-e4741da5-830b-4d0d-ab8c-101bb9cdeee4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:09:43.463587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:43.469048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:43.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 632/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:43.471007 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efdc0b-4882-445b-b84d-f003d69894d9 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:43.581104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efdc0b-4882-445b-b84d-f003d69894d9 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:43.617155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57c1e5-dc8d-4559-a845-c4343d571071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:43.617828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57c1e5-dc8d-4559-a845-c4343d571071 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:43.618111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57c1e5-dc8d-4559-a845-c4343d571071 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:43.618414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57c1e5-dc8d-4559-a845-c4343d571071 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:43.619222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57c1e5-dc8d-4559-a845-c4343d571071 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:43.619530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57c1e5-dc8d-4559-a845-c4343d571071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:43.622201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57c1e5-dc8d-4559-a845-c4343d571071 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:43.640455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 608/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 4 05:09:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:43.646534 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4741da5-830b-4d0d-ab8c-101bb9cdeee4 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:43.758271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4741da5-830b-4d0d-ab8c-101bb9cdeee4 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:43.797866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3369-00a2-414b-83b4-2b07c2c92a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:43.798506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3369-00a2-414b-83b4-2b07c2c92a34 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:43.798800 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3369-00a2-414b-83b4-2b07c2c92a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:43.799051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3369-00a2-414b-83b4-2b07c2c92a34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:43.868827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:43.875935 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee3369-00a2-414b-83b4-2b07c2c92a34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:43.877394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee3369-00a2-414b-83b4-2b07c2c92a34 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:43.987483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 633/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:09:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:09:43.994165 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57c1e5-dc8d-4559-a845-c4343d571071 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:44.023063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:44.096801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57c1e5-dc8d-4559-a845-c4343d571071 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:44.132557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63801af8-bd34-4abf-8f51-c3ddb87ca1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:44.133196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63801af8-bd34-4abf-8f51-c3ddb87ca1cd None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:44.133472 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63801af8-bd34-4abf-8f51-c3ddb87ca1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:44.133746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63801af8-bd34-4abf-8f51-c3ddb87ca1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:44.144280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63801af8-bd34-4abf-8f51-c3ddb87ca1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:44.145732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63801af8-bd34-4abf-8f51-c3ddb87ca1cd None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-63801af8-bd34-4abf-8f51-c3ddb87ca1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:44.162712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:44.163797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:44.164821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:44.164821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:44.164821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:44.164821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:44.164821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 609/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:44.170409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3369-00a2-414b-83b4-2b07c2c92a34 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:44.266122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:44.271833 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3369-00a2-414b-83b4-2b07c2c92a34 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:44.308200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841e817-7fe8-4150-a298-0fcdd3e1b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:44.309591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841e817-7fe8-4150-a298-0fcdd3e1b24e None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:44.309591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841e817-7fe8-4150-a298-0fcdd3e1b24e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:44.309591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841e817-7fe8-4150-a298-0fcdd3e1b24e None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:44.310094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841e817-7fe8-4150-a298-0fcdd3e1b24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:44.310423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841e817-7fe8-4150-a298-0fcdd3e1b24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:44.311783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841e817-7fe8-4150-a298-0fcdd3e1b24e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:44.324469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 634/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:44.330063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63801af8-bd34-4abf-8f51-c3ddb87ca1cd None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:44.413514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:44.436746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63801af8-bd34-4abf-8f51-c3ddb87ca1cd None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:44.470520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d39607-1986-423a-9b3a-07d35f47ca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:44.471169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39607-1986-423a-9b3a-07d35f47ca24 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:44.471865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39607-1986-423a-9b3a-07d35f47ca24 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:44.471865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d39607-1986-423a-9b3a-07d35f47ca24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:44.478782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d39607-1986-423a-9b3a-07d35f47ca24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:44.480776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d39607-1986-423a-9b3a-07d35f47ca24 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-c5d39607-1986-423a-9b3a-07d35f47ca24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:09:44.492328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:44.497265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:44.498417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:09:44.498417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:09:44.498417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:09:44.498417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:09:44.498417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:09:44.498417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:09:44.498417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:44.498417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:44.498417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 610/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:09:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:44.500195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841e817-7fe8-4150-a298-0fcdd3e1b24e None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:44.603793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841e817-7fe8-4150-a298-0fcdd3e1b24e None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:44.640087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a00b1-64f2-4b14-a2cb-96dd320c325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:44.641079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a00b1-64f2-4b14-a2cb-96dd320c325c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:44.641709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a00b1-64f2-4b14-a2cb-96dd320c325c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:44.642153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a00b1-64f2-4b14-a2cb-96dd320c325c None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:44.642959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a00b1-64f2-4b14-a2cb-96dd320c325c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:44.643270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a00b1-64f2-4b14-a2cb-96dd320c325c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:44.644852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a00b1-64f2-4b14-a2cb-96dd320c325c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:44.658428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 635/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:09:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:44.670964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d39607-1986-423a-9b3a-07d35f47ca24 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:44.785334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d39607-1986-423a-9b3a-07d35f47ca24 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:44.834891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf9964-c631-4cc5-b596-64fe57075595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:44.835925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf9964-c631-4cc5-b596-64fe57075595 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:44.836409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf9964-c631-4cc5-b596-64fe57075595 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:44.836905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf9964-c631-4cc5-b596-64fe57075595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:44.839063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf9964-c631-4cc5-b596-64fe57075595 None admin] RBAC: Adding query filter params (role.id=16ee851075b24775bcb2377722b5adb4, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=448d43be14a74865a1e0d09e76c7e248) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:44.839590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf9964-c631-4cc5-b596-64fe57075595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:44.842181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf9964-c631-4cc5-b596-64fe57075595 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:44.853525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 611/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:09:44 2022] GET /identity/v3/role_assignments?user.id=448d43be14a74865a1e0d09e76c7e248&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=16ee851075b24775bcb2377722b5adb4 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:47.090764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edf167-65b5-4ee6-8886-62d3c654b769 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:47.091509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edf167-65b5-4ee6-8886-62d3c654b769 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:47.091509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edf167-65b5-4ee6-8886-62d3c654b769 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:47.092698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 636/1247] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:09:47.098904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3dab3-a23f-4aa9-90ee-34f791adaaa1 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:47.099462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3dab3-a23f-4aa9-90ee-34f791adaaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:47.099462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3dab3-a23f-4aa9-90ee-34f791adaaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:47.107465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:47.121520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-4fb3dab3-a23f-4aa9-90ee-34f791adaaa1 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:47.122902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4fb3dab3-a23f-4aa9-90ee-34f791adaaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:47.208279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 612/1248] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:09:47.232596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edf167-65b5-4ee6-8886-62d3c654b769 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:47.254734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:47.347843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edf167-65b5-4ee6-8886-62d3c654b769 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:47.389288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaeb0c5-f8e4-45b3-9116-6284cd7cd82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:47.390647 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaeb0c5-f8e4-45b3-9116-6284cd7cd82b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:47.391032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaeb0c5-f8e4-45b3-9116-6284cd7cd82b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:47.391391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaeb0c5-f8e4-45b3-9116-6284cd7cd82b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:47.408479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaeb0c5-f8e4-45b3-9116-6284cd7cd82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-abaeb0c5-f8e4-45b3-9116-6284cd7cd82b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:09:47.417471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:47.419147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:47.420314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 637/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:09:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:09:47.431337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3dab3-a23f-4aa9-90ee-34f791adaaa1 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:47.587595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3dab3-a23f-4aa9-90ee-34f791adaaa1 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:47.627600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:47.636996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40521ab-e102-473d-9853-ad1be2ec9e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:47.638060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40521ab-e102-473d-9853-ad1be2ec9e3e None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:47.638545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40521ab-e102-473d-9853-ad1be2ec9e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:47.638987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40521ab-e102-473d-9853-ad1be2ec9e3e None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:47.640222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40521ab-e102-473d-9853-ad1be2ec9e3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:47.640712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40521ab-e102-473d-9853-ad1be2ec9e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:47.643110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40521ab-e102-473d-9853-ad1be2ec9e3e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:47.664478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 613/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:09:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:47.672343 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaeb0c5-f8e4-45b3-9116-6284cd7cd82b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:47.772721 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:47.799512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaeb0c5-f8e4-45b3-9116-6284cd7cd82b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:47.841133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ab713-e1fd-493f-b7ec-cc5193162d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:47.841823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ab713-e1fd-493f-b7ec-cc5193162d80 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:47.842136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ab713-e1fd-493f-b7ec-cc5193162d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:47.842488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ab713-e1fd-493f-b7ec-cc5193162d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:47.855389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ab713-e1fd-493f-b7ec-cc5193162d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:47.857008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ab713-e1fd-493f-b7ec-cc5193162d80 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-3a3ab713-e1fd-493f-b7ec-cc5193162d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:47.873486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:47.874751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:47.876635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:47.876635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:47.876635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:47.876635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:47.876635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 638/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:09:47.884440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40521ab-e102-473d-9853-ad1be2ec9e3e None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:47.996259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40521ab-e102-473d-9853-ad1be2ec9e3e None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:48.034839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704291-5200-4090-91d5-645d2b32fb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:48.035662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704291-5200-4090-91d5-645d2b32fb7c None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:48.036160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704291-5200-4090-91d5-645d2b32fb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:48.036462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704291-5200-4090-91d5-645d2b32fb7c None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:48.037255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86704291-5200-4090-91d5-645d2b32fb7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:48.037646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86704291-5200-4090-91d5-645d2b32fb7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:48.039188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86704291-5200-4090-91d5-645d2b32fb7c None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:48.054640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 614/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:48.061533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ab713-e1fd-493f-b7ec-cc5193162d80 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:48.178745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ab713-e1fd-493f-b7ec-cc5193162d80 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:48.207984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:48.217317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3784f43-6cf2-490a-91e5-abbfa2dcb00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:48.217967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784f43-6cf2-490a-91e5-abbfa2dcb00b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:48.218249 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784f43-6cf2-490a-91e5-abbfa2dcb00b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:48.218563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784f43-6cf2-490a-91e5-abbfa2dcb00b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:48.226977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3784f43-6cf2-490a-91e5-abbfa2dcb00b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:48.228477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3784f43-6cf2-490a-91e5-abbfa2dcb00b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-f3784f43-6cf2-490a-91e5-abbfa2dcb00b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:09:48.241392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:48.245659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:48.246889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 639/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:09:48.251985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704291-5200-4090-91d5-645d2b32fb7c None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:48.325998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:48.380115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704291-5200-4090-91d5-645d2b32fb7c None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:48.436893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941d9b2-ff9b-414a-a167-b08b29c62abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:48.437826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d9b2-ff9b-414a-a167-b08b29c62abf None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:48.438296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d9b2-ff9b-414a-a167-b08b29c62abf None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:48.438815 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d9b2-ff9b-414a-a167-b08b29c62abf None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:48.440336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941d9b2-ff9b-414a-a167-b08b29c62abf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:48.440893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941d9b2-ff9b-414a-a167-b08b29c62abf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:48.443681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941d9b2-ff9b-414a-a167-b08b29c62abf None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:48.476752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 615/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 4 05:09:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:48.483664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3784f43-6cf2-490a-91e5-abbfa2dcb00b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:48.602785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3784f43-6cf2-490a-91e5-abbfa2dcb00b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:48.663285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe098b40-aca7-4e0f-9d71-7588336c1531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:48.664341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098b40-aca7-4e0f-9d71-7588336c1531 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:48.664838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098b40-aca7-4e0f-9d71-7588336c1531 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:48.665315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098b40-aca7-4e0f-9d71-7588336c1531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:48.765131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:48.785478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe098b40-aca7-4e0f-9d71-7588336c1531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:48.788196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe098b40-aca7-4e0f-9d71-7588336c1531 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:48.932032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 640/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:09:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 05:09:48.938465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941d9b2-ff9b-414a-a167-b08b29c62abf None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:49.084924 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941d9b2-ff9b-414a-a167-b08b29c62abf None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:49.107920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:49.142389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7059c-54ab-4ab2-8b02-9fd511ce8dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:49.143140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7059c-54ab-4ab2-8b02-9fd511ce8dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:49.143459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7059c-54ab-4ab2-8b02-9fd511ce8dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:49.143799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7059c-54ab-4ab2-8b02-9fd511ce8dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:49.155693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7059c-54ab-4ab2-8b02-9fd511ce8dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:49.157149 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7059c-54ab-4ab2-8b02-9fd511ce8dd4 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-6ed7059c-54ab-4ab2-8b02-9fd511ce8dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:49.174564 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:49.176292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:49.178131 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:49.178131 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:49.178131 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:49.178131 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:49.178131 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 616/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:09:49.181709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe098b40-aca7-4e0f-9d71-7588336c1531 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:49.280914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:49.294004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe098b40-aca7-4e0f-9d71-7588336c1531 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:49.330959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cfd15-8445-43f7-885b-6aba7a169b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:49.331584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cfd15-8445-43f7-885b-6aba7a169b7a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:49.331857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cfd15-8445-43f7-885b-6aba7a169b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:49.332128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cfd15-8445-43f7-885b-6aba7a169b7a None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:49.332827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cfd15-8445-43f7-885b-6aba7a169b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:49.333125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cfd15-8445-43f7-885b-6aba7a169b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:49.334526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cfd15-8445-43f7-885b-6aba7a169b7a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:49.352618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 641/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:49.355006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7059c-54ab-4ab2-8b02-9fd511ce8dd4 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:49.476531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7059c-54ab-4ab2-8b02-9fd511ce8dd4 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:49.516478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510446af-857b-4508-a7ac-282925c5d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:49.517228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510446af-857b-4508-a7ac-282925c5d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:49.517552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510446af-857b-4508-a7ac-282925c5d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:49.517860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510446af-857b-4508-a7ac-282925c5d4f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:49.525472 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510446af-857b-4508-a7ac-282925c5d4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:49.526987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510446af-857b-4508-a7ac-282925c5d4f1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-510446af-857b-4508-a7ac-282925c5d4f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:09:49.539345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:49.541527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:49.542570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:09:49.542570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:09:49.542570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:09:49.542570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:09:49.542570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:09:49.542570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:09:49.542570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:49.542570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:49.542570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 617/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:09:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:09:49.548930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cfd15-8445-43f7-885b-6aba7a169b7a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:49.673639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cfd15-8445-43f7-885b-6aba7a169b7a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:49.713803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aa0aa-ff86-44be-81a9-dd56399c7114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:49.714748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aa0aa-ff86-44be-81a9-dd56399c7114 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:49.714857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aa0aa-ff86-44be-81a9-dd56399c7114 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:49.715168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aa0aa-ff86-44be-81a9-dd56399c7114 None admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:49.715970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aa0aa-ff86-44be-81a9-dd56399c7114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:49.716313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aa0aa-ff86-44be-81a9-dd56399c7114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:49.717794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aa0aa-ff86-44be-81a9-dd56399c7114 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:49.732873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 642/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:09:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:09:49.740244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510446af-857b-4508-a7ac-282925c5d4f1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:49.769383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:49.857436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510446af-857b-4508-a7ac-282925c5d4f1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:49.899413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53887861-3665-475f-ae9c-ae59d7d940fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:49.900029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53887861-3665-475f-ae9c-ae59d7d940fb None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:49.900299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53887861-3665-475f-ae9c-ae59d7d940fb None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:49.900569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53887861-3665-475f-ae9c-ae59d7d940fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:49.901974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53887861-3665-475f-ae9c-ae59d7d940fb None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=448d43be14a74865a1e0d09e76c7e248) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:49.902237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53887861-3665-475f-ae9c-ae59d7d940fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:49.903711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53887861-3665-475f-ae9c-ae59d7d940fb None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:49.909819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 618/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:09:49 2022] GET /identity/v3/role_assignments?user.id=448d43be14a74865a1e0d09e76c7e248&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:51.969448 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eda5ae-08ce-41f2-8de1-cc1a6f2c24f0 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:51.970081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eda5ae-08ce-41f2-8de1-cc1a6f2c24f0 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:51.970081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eda5ae-08ce-41f2-8de1-cc1a6f2c24f0 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:51.971692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 643/1261] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:51.977878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72323-3073-4eac-ac52-885c4859103c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:51.978529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72323-3073-4eac-ac52-885c4859103c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:51.978529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb72323-3073-4eac-ac52-885c4859103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:51.998653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-beb72323-3073-4eac-ac52-885c4859103c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:51.999882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-beb72323-3073-4eac-ac52-885c4859103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:52.071935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 619/1262] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:09:52.096024 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eda5ae-08ce-41f2-8de1-cc1a6f2c24f0 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:52.108071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:52.209181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eda5ae-08ce-41f2-8de1-cc1a6f2c24f0 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:52.247273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ec650-cebf-4d1c-ab53-b737661e916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:52.247831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec650-cebf-4d1c-ab53-b737661e916f None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:52.248100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec650-cebf-4d1c-ab53-b737661e916f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:52.248365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec650-cebf-4d1c-ab53-b737661e916f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:52.258829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ec650-cebf-4d1c-ab53-b737661e916f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-a60ec650-cebf-4d1c-ab53-b737661e916f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:09:52.264097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:52.265251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:52.266323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 644/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:52.273567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb72323-3073-4eac-ac52-885c4859103c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:52.292554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:52.377281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb72323-3073-4eac-ac52-885c4859103c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:52.413125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec24c9-0c0d-4389-9425-fa5bc343c2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:52.413750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec24c9-0c0d-4389-9425-fa5bc343c2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:52.414038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec24c9-0c0d-4389-9425-fa5bc343c2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:52.414345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec24c9-0c0d-4389-9425-fa5bc343c2a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:52.415064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec24c9-0c0d-4389-9425-fa5bc343c2a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:52.415372 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec24c9-0c0d-4389-9425-fa5bc343c2a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:52.417584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec24c9-0c0d-4389-9425-fa5bc343c2a1 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:52.426752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 620/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:09:52.432916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ec650-cebf-4d1c-ab53-b737661e916f None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:52.503438 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:52.539039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ec650-cebf-4d1c-ab53-b737661e916f None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:52.575378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00723e2f-a209-4b7e-8a34-41e39ed591c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:52.576104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723e2f-a209-4b7e-8a34-41e39ed591c1 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:52.576337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723e2f-a209-4b7e-8a34-41e39ed591c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:52.576609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723e2f-a209-4b7e-8a34-41e39ed591c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:52.589782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00723e2f-a209-4b7e-8a34-41e39ed591c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:52.591285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00723e2f-a209-4b7e-8a34-41e39ed591c1 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-00723e2f-a209-4b7e-8a34-41e39ed591c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:52.607072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:52.608205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:52.609365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:52.609365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:52.609365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:52.609365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:52.609365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 645/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:09:52.614471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec24c9-0c0d-4389-9425-fa5bc343c2a1 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:52.696864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:52.717655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec24c9-0c0d-4389-9425-fa5bc343c2a1 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:52.752900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9347b-3d0c-44cb-a683-ce732d25c5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:52.753570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9347b-3d0c-44cb-a683-ce732d25c5dd None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:52.753783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9347b-3d0c-44cb-a683-ce732d25c5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:52.754053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9347b-3d0c-44cb-a683-ce732d25c5dd None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:52.754772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9347b-3d0c-44cb-a683-ce732d25c5dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:52.755070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9347b-3d0c-44cb-a683-ce732d25c5dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:52.756432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9347b-3d0c-44cb-a683-ce732d25c5dd None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:52.770063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 621/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:52.778050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00723e2f-a209-4b7e-8a34-41e39ed591c1 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:52.892414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00723e2f-a209-4b7e-8a34-41e39ed591c1 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:52.925365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:52.942325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60b59b-a29c-4d7b-95ce-3af96aceb10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:52.942967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60b59b-a29c-4d7b-95ce-3af96aceb10b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:52.943247 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60b59b-a29c-4d7b-95ce-3af96aceb10b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:52.943518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60b59b-a29c-4d7b-95ce-3af96aceb10b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:52.951615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60b59b-a29c-4d7b-95ce-3af96aceb10b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:52.953039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60b59b-a29c-4d7b-95ce-3af96aceb10b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-5c60b59b-a29c-4d7b-95ce-3af96aceb10b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:09:52.964554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:52.965587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:52.966708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 646/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:52.973408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9347b-3d0c-44cb-a683-ce732d25c5dd None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:53.089413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9347b-3d0c-44cb-a683-ce732d25c5dd None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:53.127269 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e6526-6202-47d5-aece-5d9a66388010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:53.127887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e6526-6202-47d5-aece-5d9a66388010 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:53.128170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e6526-6202-47d5-aece-5d9a66388010 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:53.128440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e6526-6202-47d5-aece-5d9a66388010 None admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:53.129234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e6526-6202-47d5-aece-5d9a66388010 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:53.129537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e6526-6202-47d5-aece-5d9a66388010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:53.131187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e6526-6202-47d5-aece-5d9a66388010 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:53.144104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:53.155958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 622/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 4 05:09:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:53.162196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60b59b-a29c-4d7b-95ce-3af96aceb10b None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:53.273255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60b59b-a29c-4d7b-95ce-3af96aceb10b None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:53.309238 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604976d-db7b-47b3-bf47-2d75a55d6303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:53.309870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604976d-db7b-47b3-bf47-2d75a55d6303 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:53.310142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604976d-db7b-47b3-bf47-2d75a55d6303 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:53.310439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604976d-db7b-47b3-bf47-2d75a55d6303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:53.322080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604976d-db7b-47b3-bf47-2d75a55d6303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:53.324592 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604976d-db7b-47b3-bf47-2d75a55d6303 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-e604976d-db7b-47b3-bf47-2d75a55d6303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:53.339992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:53.341106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:53.342236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:53.342236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:53.342236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:53.342236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:53.342236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 647/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:53.347164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e6526-6202-47d5-aece-5d9a66388010 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:53.450641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e6526-6202-47d5-aece-5d9a66388010 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:53.488350 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd2ca2-ab48-4e24-9e08-00753655bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:53.488960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd2ca2-ab48-4e24-9e08-00753655bcaf None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:53.489236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd2ca2-ab48-4e24-9e08-00753655bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:53.489594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd2ca2-ab48-4e24-9e08-00753655bcaf None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:53.490203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd2ca2-ab48-4e24-9e08-00753655bcaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:53.490621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd2ca2-ab48-4e24-9e08-00753655bcaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:53.491897 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd2ca2-ab48-4e24-9e08-00753655bcaf None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:53.504394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 623/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:53.511223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604976d-db7b-47b3-bf47-2d75a55d6303 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:53.548460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:53.623415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604976d-db7b-47b3-bf47-2d75a55d6303 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:53.659971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3288f-60b6-4e78-8c2d-ba04e0360496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:53.660598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3288f-60b6-4e78-8c2d-ba04e0360496 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:53.660872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3288f-60b6-4e78-8c2d-ba04e0360496 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:53.661137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3288f-60b6-4e78-8c2d-ba04e0360496 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:53.668337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3288f-60b6-4e78-8c2d-ba04e0360496 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:53.669761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3288f-60b6-4e78-8c2d-ba04e0360496 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-7ee3288f-60b6-4e78-8c2d-ba04e0360496 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:09:53.681799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:53.685977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:53.687147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:09:53.687147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:09:53.687147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:09:53.687147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:09:53.687147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:09:53.687147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:09:53.687147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:53.687147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:53.687147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 648/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:09:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:53.689418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd2ca2-ab48-4e24-9e08-00753655bcaf None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:53.751242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:53.799055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd2ca2-ab48-4e24-9e08-00753655bcaf None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:53.833769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540125d6-9a59-4622-b5d0-9006c0f889d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:53.834413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540125d6-9a59-4622-b5d0-9006c0f889d7 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:53.834698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540125d6-9a59-4622-b5d0-9006c0f889d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:53.834972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540125d6-9a59-4622-b5d0-9006c0f889d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:53.835716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540125d6-9a59-4622-b5d0-9006c0f889d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:53.836028 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540125d6-9a59-4622-b5d0-9006c0f889d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:53.837449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540125d6-9a59-4622-b5d0-9006c0f889d7 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:53.850152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 624/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:09:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:53.856407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3288f-60b6-4e78-8c2d-ba04e0360496 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:53.964849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:53.973905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3288f-60b6-4e78-8c2d-ba04e0360496 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:54.015000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381b9f3-1c6f-46f2-9acb-ee3e05ab207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:54.015723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381b9f3-1c6f-46f2-9acb-ee3e05ab207f None admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:54.016008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381b9f3-1c6f-46f2-9acb-ee3e05ab207f None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:54.016277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381b9f3-1c6f-46f2-9acb-ee3e05ab207f None admin] PATH_INFO: `/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/448d43be14a74865a1e0d09e76c7e248/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:54.018348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381b9f3-1c6f-46f2-9acb-ee3e05ab207f None admin] RBAC: Authorizing `identity:create_grant(project_id=0e168d6f8f6142bdaad5e1f6bb544328, user_id=448d43be14a74865a1e0d09e76c7e248, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:54.019855 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381b9f3-1c6f-46f2-9acb-ee3e05ab207f None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:54.192380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 649/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Aug 4 05:09:53 2022] PUT /identity/v3/projects/0e168d6f8f6142bdaad5e1f6bb544328/users/448d43be14a74865a1e0d09e76c7e248/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:09:56.259646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57710691-6b7d-412f-939b-9f00d89bc2bc None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:56.261046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57710691-6b7d-412f-939b-9f00d89bc2bc None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:56.261046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57710691-6b7d-412f-939b-9f00d89bc2bc None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:56.262126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 625/1274] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:56.269140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3245-5401-46b4-adf8-f24b0bdbafe4 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:56.269676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3245-5401-46b4-adf8-f24b0bdbafe4 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:56.270030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3245-5401-46b4-adf8-f24b0bdbafe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:56.297240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0a5b3245-5401-46b4-adf8-f24b0bdbafe4 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:56.299185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0a5b3245-5401-46b4-adf8-f24b0bdbafe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:56.394223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 650/1275] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:09:56.419191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57710691-6b7d-412f-939b-9f00d89bc2bc None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:56.543210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57710691-6b7d-412f-939b-9f00d89bc2bc None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:56.561961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:56.581320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc0c68-8135-4957-958f-88fd2e7d2466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:56.581968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc0c68-8135-4957-958f-88fd2e7d2466 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:56.582336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc0c68-8135-4957-958f-88fd2e7d2466 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:56.582616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc0c68-8135-4957-958f-88fd2e7d2466 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:56.594329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc0c68-8135-4957-958f-88fd2e7d2466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-02fc0c68-8135-4957-958f-88fd2e7d2466 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:09:56.599379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:56.605447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:56.607441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 626/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Aug 4 05:09:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:56.610874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3245-5401-46b4-adf8-f24b0bdbafe4 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:56.727640 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:56.757078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3245-5401-46b4-adf8-f24b0bdbafe4 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:56.808449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aa588-b055-48cd-a136-1cc322101567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:56.809064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aa588-b055-48cd-a136-1cc322101567 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:56.809333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aa588-b055-48cd-a136-1cc322101567 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:56.809603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aa588-b055-48cd-a136-1cc322101567 None admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:56.810406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802aa588-b055-48cd-a136-1cc322101567 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:56.810642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802aa588-b055-48cd-a136-1cc322101567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:56.812021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802aa588-b055-48cd-a136-1cc322101567 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:56.821354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 651/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Aug 4 05:09:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:56.828346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc0c68-8135-4957-958f-88fd2e7d2466 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:56.941608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc0c68-8135-4957-958f-88fd2e7d2466 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:56.977272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00601-a2cc-4d73-8bcb-13aa2f25218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:56.978006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00601-a2cc-4d73-8bcb-13aa2f25218f None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:56.978184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00601-a2cc-4d73-8bcb-13aa2f25218f None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:56.978567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00601-a2cc-4d73-8bcb-13aa2f25218f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:56.989567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e00601-a2cc-4d73-8bcb-13aa2f25218f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:56.991048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e00601-a2cc-4d73-8bcb-13aa2f25218f None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-a2e00601-a2cc-4d73-8bcb-13aa2f25218f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:57.007355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:57.009099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:57.011759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:57.011759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:57.011759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:57.011759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:57.011759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 627/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:57.015351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aa588-b055-48cd-a136-1cc322101567 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:57.123823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aa588-b055-48cd-a136-1cc322101567 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:57.171284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593ffab-aa52-4c2c-8598-3dfb282bda84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:57.172000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593ffab-aa52-4c2c-8598-3dfb282bda84 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:57.172378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593ffab-aa52-4c2c-8598-3dfb282bda84 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:57.172741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593ffab-aa52-4c2c-8598-3dfb282bda84 None admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:57.173536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593ffab-aa52-4c2c-8598-3dfb282bda84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:57.173925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593ffab-aa52-4c2c-8598-3dfb282bda84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:57.175459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593ffab-aa52-4c2c-8598-3dfb282bda84 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:57.189476 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 652/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:09:57.198934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00601-a2cc-4d73-8bcb-13aa2f25218f None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:57.234677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:57.336908 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00601-a2cc-4d73-8bcb-13aa2f25218f None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:57.374127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bf254-0a59-4881-8ad1-59df8d04f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:57.374793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf254-0a59-4881-8ad1-59df8d04f970 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:57.375065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf254-0a59-4881-8ad1-59df8d04f970 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:57.375330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf254-0a59-4881-8ad1-59df8d04f970 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:57.382557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bf254-0a59-4881-8ad1-59df8d04f970 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:57.383990 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bf254-0a59-4881-8ad1-59df8d04f970 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-379bf254-0a59-4881-8ad1-59df8d04f970 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:09:57.396677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:57.398407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:09:57.400246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 628/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:57.405092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593ffab-aa52-4c2c-8598-3dfb282bda84 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:57.417580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:57.505221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593ffab-aa52-4c2c-8598-3dfb282bda84 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:57.544444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b12c3f-288d-4011-8c21-0987dbfe656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:57.545118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b12c3f-288d-4011-8c21-0987dbfe656c None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:57.545389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b12c3f-288d-4011-8c21-0987dbfe656c None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:57.545658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b12c3f-288d-4011-8c21-0987dbfe656c None admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:57.546761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b12c3f-288d-4011-8c21-0987dbfe656c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:57.547064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b12c3f-288d-4011-8c21-0987dbfe656c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:57.548569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b12c3f-288d-4011-8c21-0987dbfe656c None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:57.571201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 653/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Aug 4 05:09:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:57.578238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bf254-0a59-4881-8ad1-59df8d04f970 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:57.686976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:57.698810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bf254-0a59-4881-8ad1-59df8d04f970 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:57.741538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a48909-d86e-4a66-b837-58dd251e1603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:57.742197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48909-d86e-4a66-b837-58dd251e1603 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:57.742506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48909-d86e-4a66-b837-58dd251e1603 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:57.742777 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a48909-d86e-4a66-b837-58dd251e1603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:57.820103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a48909-d86e-4a66-b837-58dd251e1603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:57.821559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a48909-d86e-4a66-b837-58dd251e1603 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:57.918953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:57.929576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 629/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Aug 4 05:09:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:09:57.935750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b12c3f-288d-4011-8c21-0987dbfe656c None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:58.001339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:58.042555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b12c3f-288d-4011-8c21-0987dbfe656c None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:58.079739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126b455-fd70-4009-977a-50b234010151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:58.080459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126b455-fd70-4009-977a-50b234010151 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:58.080833 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126b455-fd70-4009-977a-50b234010151 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:58.081197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126b455-fd70-4009-977a-50b234010151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:58.093804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126b455-fd70-4009-977a-50b234010151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:58.095289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126b455-fd70-4009-977a-50b234010151 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-a126b455-fd70-4009-977a-50b234010151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:09:58.110962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:58.112197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:58.113950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:09:58.113950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:09:58.113950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:09:58.113950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:58.113950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 654/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:58.118694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a48909-d86e-4a66-b837-58dd251e1603 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:58.231918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a48909-d86e-4a66-b837-58dd251e1603 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:58.269619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3f16c-d1a6-4407-a002-22b4f8746bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:58.270179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3f16c-d1a6-4407-a002-22b4f8746bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:58.270466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3f16c-d1a6-4407-a002-22b4f8746bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:58.270733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3f16c-d1a6-4407-a002-22b4f8746bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:58.271433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3f16c-d1a6-4407-a002-22b4f8746bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:58.271734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3f16c-d1a6-4407-a002-22b4f8746bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:58.273096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3f16c-d1a6-4407-a002-22b4f8746bd0 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:58.285943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 630/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Aug 4 05:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:58.292627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126b455-fd70-4009-977a-50b234010151 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:58.411371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126b455-fd70-4009-977a-50b234010151 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:58.426206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:58.446661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328b4e3-e21d-41e6-b608-7935c155aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:58.447986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328b4e3-e21d-41e6-b608-7935c155aa9a None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:58.448468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328b4e3-e21d-41e6-b608-7935c155aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:58.448468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328b4e3-e21d-41e6-b608-7935c155aa9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:58.455234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328b4e3-e21d-41e6-b608-7935c155aa9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:58.456664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328b4e3-e21d-41e6-b608-7935c155aa9a None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application [None req-1328b4e3-e21d-41e6-b608-7935c155aa9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:09:58.467994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application with Lock( Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:09:58.469045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:09:58.470846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:09:58.470846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:09:58.470846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:09:58.470846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:09:58.470846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:09:58.470846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:09:58.470846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:09:58.470846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: ERROR keystone.server.flask.application Aug 04 05:09:58.470846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 655/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Aug 4 05:09:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:09:58.476478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3f16c-d1a6-4407-a002-22b4f8746bd0 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:58.532484 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:58.585688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3f16c-d1a6-4407-a002-22b4f8746bd0 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:58.622494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108dc4f-2ee8-4f0a-87f8-46da71b13416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:58.623123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108dc4f-2ee8-4f0a-87f8-46da71b13416 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:58.623405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108dc4f-2ee8-4f0a-87f8-46da71b13416 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:58.623681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108dc4f-2ee8-4f0a-87f8-46da71b13416 None admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:58.624442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108dc4f-2ee8-4f0a-87f8-46da71b13416 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:58.624751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108dc4f-2ee8-4f0a-87f8-46da71b13416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:58.626204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108dc4f-2ee8-4f0a-87f8-46da71b13416 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:58.640446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 631/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Aug 4 05:09:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:09:58.646818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328b4e3-e21d-41e6-b608-7935c155aa9a None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:58.763274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328b4e3-e21d-41e6-b608-7935c155aa9a None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:58.801050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f91af-1dde-4cce-9289-a8387db29e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:58.801720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f91af-1dde-4cce-9289-a8387db29e9b None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:58.802039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f91af-1dde-4cce-9289-a8387db29e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:58.802377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f91af-1dde-4cce-9289-a8387db29e9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:58.803214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f91af-1dde-4cce-9289-a8387db29e9b None admin] RBAC: Adding query filter params (role.id=137fc99a654a41f09c3203a6c50d3555, scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328, user.id=448d43be14a74865a1e0d09e76c7e248) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:09:58.803567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f91af-1dde-4cce-9289-a8387db29e9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:58.805136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f91af-1dde-4cce-9289-a8387db29e9b None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:58.813132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 656/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Aug 4 05:09:58 2022] GET /identity/v3/role_assignments?user.id=448d43be14a74865a1e0d09e76c7e248&scope.project.id=0e168d6f8f6142bdaad5e1f6bb544328&role.id=137fc99a654a41f09c3203a6c50d3555 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:10:00.942157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd89c8-c1a0-4871-9ebb-faba46d796bd None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:00.942923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd89c8-c1a0-4871-9ebb-faba46d796bd None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:00.942923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd89c8-c1a0-4871-9ebb-faba46d796bd None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:00.944074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 632/1288] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:00.950190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16065b0-0087-47da-80cc-08b05a30ada4 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:00.950761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16065b0-0087-47da-80cc-08b05a30ada4 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:00.950761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16065b0-0087-47da-80cc-08b05a30ada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:00.971196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c16065b0-0087-47da-80cc-08b05a30ada4 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:00.972505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c16065b0-0087-47da-80cc-08b05a30ada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:01.006127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:01.047694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 657/1289] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:10:01.070331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd89c8-c1a0-4871-9ebb-faba46d796bd None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:01.228113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd89c8-c1a0-4871-9ebb-faba46d796bd None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:01.241899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:01.271278 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6e715-3cf0-4570-9fbc-94359095e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:01.271959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6e715-3cf0-4570-9fbc-94359095e278 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:01.272232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6e715-3cf0-4570-9fbc-94359095e278 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:01.272509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6e715-3cf0-4570-9fbc-94359095e278 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:01.273361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6e715-3cf0-4570-9fbc-94359095e278 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:01.274857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6e715-3cf0-4570-9fbc-94359095e278 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-68c6e715-3cf0-4570-9fbc-94359095e278 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:10:01.285533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:10:01.287420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:10:01.288614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 633/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 4 05:10:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:10:01.294155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16065b0-0087-47da-80cc-08b05a30ada4 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:01.429447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16065b0-0087-47da-80cc-08b05a30ada4 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:01.471083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e903a8c-ab97-47a6-9a20-fa1cd49571a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:01.471728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e903a8c-ab97-47a6-9a20-fa1cd49571a7 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:01.472002 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e903a8c-ab97-47a6-9a20-fa1cd49571a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:01.472273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e903a8c-ab97-47a6-9a20-fa1cd49571a7 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:01.473035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e903a8c-ab97-47a6-9a20-fa1cd49571a7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:10:01.473343 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e903a8c-ab97-47a6-9a20-fa1cd49571a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:01.474781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e903a8c-ab97-47a6-9a20-fa1cd49571a7 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:01.480994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 658/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Aug 4 05:10:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:10:01.486904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6e715-3cf0-4570-9fbc-94359095e278 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:01.608161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6e715-3cf0-4570-9fbc-94359095e278 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:01.644673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891be71-b37a-4c19-ab8b-362ad472a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:01.645301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891be71-b37a-4c19-ab8b-362ad472a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:01.645578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891be71-b37a-4c19-ab8b-362ad472a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:01.645861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891be71-b37a-4c19-ab8b-362ad472a6e8 None admin] PATH_INFO: `/v3/services` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:01.646575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891be71-b37a-4c19-ab8b-362ad472a6e8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:10:01.646872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891be71-b37a-4c19-ab8b-362ad472a6e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:01.648230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891be71-b37a-4c19-ab8b-362ad472a6e8 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:01.653482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 634/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Aug 4 05:10:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:10:03.738764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dd4c0-9afe-4b1c-901c-ac15448d7a2f None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:03.739589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dd4c0-9afe-4b1c-901c-ac15448d7a2f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:03.739589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dd4c0-9afe-4b1c-901c-ac15448d7a2f None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:03.740664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 659/1293] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:03.747012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8c42f-1a1c-4d4a-8743-710685ac2e91 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:03.747838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8c42f-1a1c-4d4a-8743-710685ac2e91 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:03.748004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8c42f-1a1c-4d4a-8743-710685ac2e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:03.768009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-96a8c42f-1a1c-4d4a-8743-710685ac2e91 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:03.769413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-96a8c42f-1a1c-4d4a-8743-710685ac2e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:03.803008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:03.842629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 635/1294] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:10:03.866779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dd4c0-9afe-4b1c-901c-ac15448d7a2f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:03.902742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:03.975463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dd4c0-9afe-4b1c-901c-ac15448d7a2f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:04.017329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d038e8-5e06-4764-84c7-20bec3e6231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:04.017866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d038e8-5e06-4764-84c7-20bec3e6231e None admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:04.018137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d038e8-5e06-4764-84c7-20bec3e6231e None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:04.018434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d038e8-5e06-4764-84c7-20bec3e6231e None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:04.019123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d038e8-5e06-4764-84c7-20bec3e6231e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:04.021821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d038e8-5e06-4764-84c7-20bec3e6231e None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:04.128101 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 660/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Aug 4 05:10:03 2022] POST /identity/v3/services => generated 246 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:10:06.311784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6171bb-0d8e-4f8c-8b69-915870834fee None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:06.312358 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6171bb-0d8e-4f8c-8b69-915870834fee None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:06.312464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6171bb-0d8e-4f8c-8b69-915870834fee None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:06.314073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 636/1296] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:06.319991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fda12-9457-4cdb-bb2d-b5e7e76b1a52 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:06.321266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fda12-9457-4cdb-bb2d-b5e7e76b1a52 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:06.321266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fda12-9457-4cdb-bb2d-b5e7e76b1a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:06.341021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-240fda12-9457-4cdb-bb2d-b5e7e76b1a52 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:06.355035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-240fda12-9457-4cdb-bb2d-b5e7e76b1a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:06.419740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 661/1297] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:10:06.442547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6171bb-0d8e-4f8c-8b69-915870834fee None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:06.549931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6171bb-0d8e-4f8c-8b69-915870834fee None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:06.587179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c1c8e-7299-42bd-9cf7-d11d13061259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:06.588573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c1c8e-7299-42bd-9cf7-d11d13061259 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:06.589036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c1c8e-7299-42bd-9cf7-d11d13061259 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:06.589319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c1c8e-7299-42bd-9cf7-d11d13061259 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:06.589951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c1c8e-7299-42bd-9cf7-d11d13061259 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:06.591376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c1c8e-7299-42bd-9cf7-d11d13061259 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-038c1c8e-7299-42bd-9cf7-d11d13061259 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:10:06.600568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:10:06.605157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:10:06.606578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 637/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 4 05:10:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:10:06.608255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fda12-9457-4cdb-bb2d-b5e7e76b1a52 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:06.627498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:06.710851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fda12-9457-4cdb-bb2d-b5e7e76b1a52 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:06.746019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ecbf-e067-4b2c-baa1-d4bfcaa89f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:06.746664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ecbf-e067-4b2c-baa1-d4bfcaa89f00 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:06.746946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ecbf-e067-4b2c-baa1-d4bfcaa89f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:06.747220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ecbf-e067-4b2c-baa1-d4bfcaa89f00 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:06.747902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ecbf-e067-4b2c-baa1-d4bfcaa89f00 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:10:06.748206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ecbf-e067-4b2c-baa1-d4bfcaa89f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:06.749576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ecbf-e067-4b2c-baa1-d4bfcaa89f00 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:06.754954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 662/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Aug 4 05:10:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:10:06.762036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c1c8e-7299-42bd-9cf7-d11d13061259 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:06.799913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:06.871536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c1c8e-7299-42bd-9cf7-d11d13061259 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:06.907361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26994825-6011-4fbb-a652-07ba1095fe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:06.907972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994825-6011-4fbb-a652-07ba1095fe73 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:06.908252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994825-6011-4fbb-a652-07ba1095fe73 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:06.908523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994825-6011-4fbb-a652-07ba1095fe73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:06.909270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26994825-6011-4fbb-a652-07ba1095fe73 None admin] RBAC: Adding query filter params (interface=public, service_id=999ba42015394744bc56e2cdb8d5ea97, region_id=RegionOne) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:10:06.909575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26994825-6011-4fbb-a652-07ba1095fe73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:06.911015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26994825-6011-4fbb-a652-07ba1095fe73 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:06.916644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 638/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Aug 4 05:10:06 2022] GET /identity/v3/endpoints?service_id=999ba42015394744bc56e2cdb8d5ea97&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:10:06.922834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ecbf-e067-4b2c-baa1-d4bfcaa89f00 None admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:07.007664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:07.027476 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ecbf-e067-4b2c-baa1-d4bfcaa89f00 None admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:07.064579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd04b6-931e-46c8-8d87-b80a50583531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:07.065269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd04b6-931e-46c8-8d87-b80a50583531 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:07.065542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd04b6-931e-46c8-8d87-b80a50583531 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:07.065807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd04b6-931e-46c8-8d87-b80a50583531 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:07.066533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd04b6-931e-46c8-8d87-b80a50583531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:07.067939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd04b6-931e-46c8-8d87-b80a50583531 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:07.076960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 663/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Aug 4 05:10:06 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:10:09.153550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c52b-ccd4-43fc-9e44-f5e76c3601cb None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:09.154115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c52b-ccd4-43fc-9e44-f5e76c3601cb None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:09.154115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c52b-ccd4-43fc-9e44-f5e76c3601cb None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:09.155505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 639/1302] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:09.162574 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e8e42-cfbd-4c4b-b7e4-7857219d6cdb None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:09.163140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e8e42-cfbd-4c4b-b7e4-7857219d6cdb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:09.163480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e8e42-cfbd-4c4b-b7e4-7857219d6cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:09.183625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3a7e8e42-cfbd-4c4b-b7e4-7857219d6cdb None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:09.184837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3a7e8e42-cfbd-4c4b-b7e4-7857219d6cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:09.257345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 664/1303] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:10:09.280586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c52b-ccd4-43fc-9e44-f5e76c3601cb None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:09.381610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:09.389041 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c52b-ccd4-43fc-9e44-f5e76c3601cb None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:09.425027 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd088a34-2f9b-43ce-8c52-d1388b6060e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:09.425642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088a34-2f9b-43ce-8c52-d1388b6060e2 None admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:09.425920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088a34-2f9b-43ce-8c52-d1388b6060e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:09.426188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088a34-2f9b-43ce-8c52-d1388b6060e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:09.426840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd088a34-2f9b-43ce-8c52-d1388b6060e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:09.428215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd088a34-2f9b-43ce-8c52-d1388b6060e2 None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application [None req-dd088a34-2f9b-43ce-8c52-d1388b6060e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:10:09.437525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:10:09.440360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application with Lock( Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: ERROR keystone.server.flask.application Aug 04 05:10:09.441446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 640/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Aug 4 05:10:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:10:09.448151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e8e42-cfbd-4c4b-b7e4-7857219d6cdb None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:09.537607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:09.564991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e8e42-cfbd-4c4b-b7e4-7857219d6cdb None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:09.607825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505100f-6505-4ede-b7d9-cd9efd0d1f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:09.608511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505100f-6505-4ede-b7d9-cd9efd0d1f29 None admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:09.608842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505100f-6505-4ede-b7d9-cd9efd0d1f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:09.609159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505100f-6505-4ede-b7d9-cd9efd0d1f29 None admin] PATH_INFO: `/v3/services` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:09.609911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505100f-6505-4ede-b7d9-cd9efd0d1f29 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:10:09.610256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505100f-6505-4ede-b7d9-cd9efd0d1f29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:09.611755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505100f-6505-4ede-b7d9-cd9efd0d1f29 None admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:09.617588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 665/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Aug 4 05:10:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:10:09.626714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd088a34-2f9b-43ce-8c52-d1388b6060e2 None admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:09.740660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd088a34-2f9b-43ce-8c52-d1388b6060e2 None admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:09.783279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441f206-5136-44f5-b16f-4d1aaa8b343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:09.783906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441f206-5136-44f5-b16f-4d1aaa8b343e None admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:09.784354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441f206-5136-44f5-b16f-4d1aaa8b343e None admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:09.784644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441f206-5136-44f5-b16f-4d1aaa8b343e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:09.785381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441f206-5136-44f5-b16f-4d1aaa8b343e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:09.786978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441f206-5136-44f5-b16f-4d1aaa8b343e None admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:09.900996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 641/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:10:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:10:19.614335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=30 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:19.893512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:32.315656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef7ca-4f49-4fe4-9a22-bc49a31096c4 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:32.316563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef7ca-4f49-4fe4-9a22-bc49a31096c4 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:32.317217 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef7ca-4f49-4fe4-9a22-bc49a31096c4 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:32.324515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c354f-e35d-4081-8f67-ec52472ee560 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:32.330712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c354f-e35d-4081-8f67-ec52472ee560 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:32.330712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c354f-e35d-4081-8f67-ec52472ee560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:32.331010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 666/1307] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:16:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:32.409604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-7d9c354f-e35d-4081-8f67-ec52472ee560 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:32.411669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7d9c354f-e35d-4081-8f67-ec52472ee560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:32.534757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 642/1308] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:32.586896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de51470-eab2-4ca4-afe2-67edda5e144d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:32.587422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de51470-eab2-4ca4-afe2-67edda5e144d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:32.587859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de51470-eab2-4ca4-afe2-67edda5e144d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:32.590797 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 667/1309] 10.222.0.46 () {54 vars in 965 bytes} [Thu Aug 4 05:16:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:16:32.599257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3acc78-1a8d-4678-9dae-8f9d47985ce4 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:32.599452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3acc78-1a8d-4678-9dae-8f9d47985ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:32.599732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3acc78-1a8d-4678-9dae-8f9d47985ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:32.785496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ce3acc78-1a8d-4678-9dae-8f9d47985ce4 None None] MFA Rules not processed for user `4213a478acfe4cc88df41b3da2d581ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:32.790346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ce3acc78-1a8d-4678-9dae-8f9d47985ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:32.837422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:32.928528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 643/1310] 10.222.0.46 () {58 vars in 1062 bytes} [Thu Aug 4 05:16:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:32.937327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de51470-eab2-4ca4-afe2-67edda5e144d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:32.939114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7de51470-eab2-4ca4-afe2-67edda5e144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:33.068302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de51470-eab2-4ca4-afe2-67edda5e144d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:33.157793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c806c36-fe6f-481b-ae16-ed14197cf8d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:33.158517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806c36-fe6f-481b-ae16-ed14197cf8d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:33.158801 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806c36-fe6f-481b-ae16-ed14197cf8d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:33.159075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806c36-fe6f-481b-ae16-ed14197cf8d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:33.161521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2c806c36-fe6f-481b-ae16-ed14197cf8d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:33.228888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:33.293322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c806c36-fe6f-481b-ae16-ed14197cf8d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:33.294947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c806c36-fe6f-481b-ae16-ed14197cf8d1 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:33.318658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 668/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:35.681356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0125a-3383-46db-9fbc-9e69c3fe844c None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:35.681898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0125a-3383-46db-9fbc-9e69c3fe844c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:35.681898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0125a-3383-46db-9fbc-9e69c3fe844c None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:35.683297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 644/1312] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:35.688619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb720dd-9157-4441-9eb4-fd5771c0202d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:35.689059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb720dd-9157-4441-9eb4-fd5771c0202d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:35.689285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb720dd-9157-4441-9eb4-fd5771c0202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:35.771764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3eb720dd-9157-4441-9eb4-fd5771c0202d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:35.772954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3eb720dd-9157-4441-9eb4-fd5771c0202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:35.872341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 669/1313] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:16:35.911993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0125a-3383-46db-9fbc-9e69c3fe844c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:35.914106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-fbe0125a-3383-46db-9fbc-9e69c3fe844c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:36.019812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0125a-3383-46db-9fbc-9e69c3fe844c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:36.100279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:36.103011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca604a3-9bcd-413b-9c78-de53f3e45470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:36.103642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca604a3-9bcd-413b-9c78-de53f3e45470 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:36.103917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca604a3-9bcd-413b-9c78-de53f3e45470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:36.104192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca604a3-9bcd-413b-9c78-de53f3e45470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:36.105933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-bca604a3-9bcd-413b-9c78-de53f3e45470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:36.226603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca604a3-9bcd-413b-9c78-de53f3e45470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:36.227942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca604a3-9bcd-413b-9c78-de53f3e45470 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:36.247133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 645/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:38.728530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45350291-c3dd-43bd-9b34-d0087dc71497 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:38.729058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45350291-c3dd-43bd-9b34-d0087dc71497 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:38.729058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45350291-c3dd-43bd-9b34-d0087dc71497 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:38.730383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 670/1315] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:38.735874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ebd0e-b568-4696-bfd7-fc807a2a55fb None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:38.736319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ebd0e-b568-4696-bfd7-fc807a2a55fb None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:38.736476 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ebd0e-b568-4696-bfd7-fc807a2a55fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:38.802989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e66ebd0e-b568-4696-bfd7-fc807a2a55fb None None] MFA Rules not processed for user `e0489743915a4b6fb0142190909fa24c`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:38.804217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e66ebd0e-b568-4696-bfd7-fc807a2a55fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:38.858422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:38.902194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 646/1316] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:16:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:38.943548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45350291-c3dd-43bd-9b34-d0087dc71497 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:38.945090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-45350291-c3dd-43bd-9b34-d0087dc71497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:38.954801 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:39.052470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45350291-c3dd-43bd-9b34-d0087dc71497 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:39.126120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030a10f-458a-47f5-b5f2-3aefa0a82563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:39.126763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030a10f-458a-47f5-b5f2-3aefa0a82563 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:39.127039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030a10f-458a-47f5-b5f2-3aefa0a82563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:39.127305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030a10f-458a-47f5-b5f2-3aefa0a82563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:39.128920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9030a10f-458a-47f5-b5f2-3aefa0a82563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:39.191525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:39.237077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030a10f-458a-47f5-b5f2-3aefa0a82563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:39.238535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030a10f-458a-47f5-b5f2-3aefa0a82563 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:39.256801 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 671/1317] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:42.214041 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22333b-b508-440a-896a-069a13b831ac None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:42.214681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22333b-b508-440a-896a-069a13b831ac None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:42.214681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22333b-b508-440a-896a-069a13b831ac None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:42.216009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 647/1318] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:16:42.221355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d3c07-10c8-4ad4-a9d1-732ecb3eb576 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:42.221788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d3c07-10c8-4ad4-a9d1-732ecb3eb576 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:42.221892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d3c07-10c8-4ad4-a9d1-732ecb3eb576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:42.289413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ed7d3c07-10c8-4ad4-a9d1-732ecb3eb576 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:42.290640 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ed7d3c07-10c8-4ad4-a9d1-732ecb3eb576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:42.386883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 672/1319] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:16:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:42.441482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06df2-875b-4eff-83d8-f2e453d8085f None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:42.441757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06df2-875b-4eff-83d8-f2e453d8085f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:42.442045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06df2-875b-4eff-83d8-f2e453d8085f None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:42.443639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 648/1320] 10.222.0.46 () {54 vars in 965 bytes} [Thu Aug 4 05:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:42.449515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bb711-8422-4e25-96a9-8b44361a9d8e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:42.449802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bb711-8422-4e25-96a9-8b44361a9d8e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:42.450077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bb711-8422-4e25-96a9-8b44361a9d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:42.471756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:42.525562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a51bb711-8422-4e25-96a9-8b44361a9d8e None None] MFA Rules not processed for user `4213a478acfe4cc88df41b3da2d581ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:42.527079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a51bb711-8422-4e25-96a9-8b44361a9d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:42.603552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 673/1321] 10.222.0.46 () {58 vars in 1062 bytes} [Thu Aug 4 05:16:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:16:42.612482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb06df2-875b-4eff-83d8-f2e453d8085f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:42.614063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7cb06df2-875b-4eff-83d8-f2e453d8085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:42.716378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb06df2-875b-4eff-83d8-f2e453d8085f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:42.788909 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7d332-8457-4d79-a609-040ad1f672a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:42.789517 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7d332-8457-4d79-a609-040ad1f672a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:42.789868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7d332-8457-4d79-a609-040ad1f672a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:42.790055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7d332-8457-4d79-a609-040ad1f672a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:42.791684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e5f7d332-8457-4d79-a609-040ad1f672a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:42.798932 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:42.899527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7d332-8457-4d79-a609-040ad1f672a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:42.900970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7d332-8457-4d79-a609-040ad1f672a9 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:42.920334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 649/1322] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:46.413251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c534e-752c-4379-8072-fee46cf18868 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:46.414056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c534e-752c-4379-8072-fee46cf18868 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:46.414056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c534e-752c-4379-8072-fee46cf18868 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:46.415433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 674/1323] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:16:46.420789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfc32f-28a4-4d13-bae7-c6b5e4a1134e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:46.421230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfc32f-28a4-4d13-bae7-c6b5e4a1134e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:46.421325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfc32f-28a4-4d13-bae7-c6b5e4a1134e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:46.493706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ccdfc32f-28a4-4d13-bae7-c6b5e4a1134e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:46.494938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ccdfc32f-28a4-4d13-bae7-c6b5e4a1134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:46.556676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:46.597078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 650/1324] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:46.634495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c534e-752c-4379-8072-fee46cf18868 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:46.636008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0e6c534e-752c-4379-8072-fee46cf18868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:46.750932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c534e-752c-4379-8072-fee46cf18868 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:46.767178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:46.833114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2f6b9-57e9-4a67-a967-f578ea3208a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:46.833838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2f6b9-57e9-4a67-a967-f578ea3208a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:46.834047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2f6b9-57e9-4a67-a967-f578ea3208a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:46.834252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2f6b9-57e9-4a67-a967-f578ea3208a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:46.835907 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-49e2f6b9-57e9-4a67-a967-f578ea3208a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:46.951916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2f6b9-57e9-4a67-a967-f578ea3208a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:46.953368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2f6b9-57e9-4a67-a967-f578ea3208a8 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:46.972064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 675/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:49.063311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81316d-76f8-4b9b-bec7-deefd5ada2ae None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:49.064179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81316d-76f8-4b9b-bec7-deefd5ada2ae None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:49.064179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81316d-76f8-4b9b-bec7-deefd5ada2ae None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:49.065651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 651/1326] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:49.072142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7c25d-56ec-45b0-ace1-11de5fbab391 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:49.072683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7c25d-56ec-45b0-ace1-11de5fbab391 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:49.072683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7c25d-56ec-45b0-ace1-11de5fbab391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:49.135256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:49.148661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-90f7c25d-56ec-45b0-ace1-11de5fbab391 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:49.150127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-90f7c25d-56ec-45b0-ace1-11de5fbab391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:49.266038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 676/1327] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:49.303966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81316d-76f8-4b9b-bec7-deefd5ada2ae None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:49.305504 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cf81316d-76f8-4b9b-bec7-deefd5ada2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:49.430724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81316d-76f8-4b9b-bec7-deefd5ada2ae None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:49.507497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e486b38-5a2a-498d-b14c-9d9cfa86d005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:49.508121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e486b38-5a2a-498d-b14c-9d9cfa86d005 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:49.508397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e486b38-5a2a-498d-b14c-9d9cfa86d005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:49.508667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e486b38-5a2a-498d-b14c-9d9cfa86d005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:49.510338 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3e486b38-5a2a-498d-b14c-9d9cfa86d005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:49.528749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:49.632565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e486b38-5a2a-498d-b14c-9d9cfa86d005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:49.634016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e486b38-5a2a-498d-b14c-9d9cfa86d005 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:49.653025 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 652/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:51.748262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474bbd-7259-4206-964e-3e4b700d8fa6 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:51.748798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474bbd-7259-4206-964e-3e4b700d8fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:51.748798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474bbd-7259-4206-964e-3e4b700d8fa6 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:51.750145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 677/1329] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:51.756180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8128e9-e959-483b-9834-356602347f57 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:51.756685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8128e9-e959-483b-9834-356602347f57 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:51.756787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8128e9-e959-483b-9834-356602347f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:51.830780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-fc8128e9-e959-483b-9834-356602347f57 None None] MFA Rules not processed for user `e0489743915a4b6fb0142190909fa24c`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:51.832031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-fc8128e9-e959-483b-9834-356602347f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:51.902013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:51.934001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 653/1330] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:16:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:51.972046 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a474bbd-7259-4206-964e-3e4b700d8fa6 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:51.974693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5a474bbd-7259-4206-964e-3e4b700d8fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:52.081794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a474bbd-7259-4206-964e-3e4b700d8fa6 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:52.105780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:52.183533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b16cc-9385-45e4-b312-9dc56ff1070e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:52.184163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b16cc-9385-45e4-b312-9dc56ff1070e service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:52.184434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b16cc-9385-45e4-b312-9dc56ff1070e service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:52.184703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b16cc-9385-45e4-b312-9dc56ff1070e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:52.186559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d32b16cc-9385-45e4-b312-9dc56ff1070e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:52.308329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b16cc-9385-45e4-b312-9dc56ff1070e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:52.309685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b16cc-9385-45e4-b312-9dc56ff1070e service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:52.328989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 678/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:54.868645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163c557-4295-4fbd-9f1b-2669641e094a None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:54.869178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163c557-4295-4fbd-9f1b-2669641e094a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:54.869178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163c557-4295-4fbd-9f1b-2669641e094a None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:54.870549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 654/1332] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:54.875706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430cde9-6df4-43ce-9dd7-ea415a1490b8 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:54.876096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430cde9-6df4-43ce-9dd7-ea415a1490b8 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:54.876256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430cde9-6df4-43ce-9dd7-ea415a1490b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:54.939655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:54.942858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-5430cde9-6df4-43ce-9dd7-ea415a1490b8 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:54.944155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5430cde9-6df4-43ce-9dd7-ea415a1490b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:55.042413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 679/1333] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:55.079724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163c557-4295-4fbd-9f1b-2669641e094a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:55.081328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2163c557-4295-4fbd-9f1b-2669641e094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:55.191018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163c557-4295-4fbd-9f1b-2669641e094a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:55.269613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b735a-6e0f-4e2b-91db-244c76364239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:55.270457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b735a-6e0f-4e2b-91db-244c76364239 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:55.270726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b735a-6e0f-4e2b-91db-244c76364239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:55.270992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b735a-6e0f-4e2b-91db-244c76364239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:55.272653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-895b735a-6e0f-4e2b-91db-244c76364239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:55.300300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:55.384010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b735a-6e0f-4e2b-91db-244c76364239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:55.385450 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b735a-6e0f-4e2b-91db-244c76364239 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:55.404520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 655/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:57.582610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bdbbb-6bf3-4b3c-8b71-91e89447d299 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:57.583146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bdbbb-6bf3-4b3c-8b71-91e89447d299 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:57.583146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bdbbb-6bf3-4b3c-8b71-91e89447d299 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:57.584428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 680/1335] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:57.589736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0b42e-61d9-4a85-a30a-9dbe0f754821 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:57.590235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0b42e-61d9-4a85-a30a-9dbe0f754821 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:57.590386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0b42e-61d9-4a85-a30a-9dbe0f754821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:57.655801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-83c0b42e-61d9-4a85-a30a-9dbe0f754821 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:57.657009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-83c0b42e-61d9-4a85-a30a-9dbe0f754821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:57.732836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:57.757132 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 656/1336] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:57.799220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bdbbb-6bf3-4b3c-8b71-91e89447d299 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:57.800764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bd7bdbbb-6bf3-4b3c-8b71-91e89447d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:57.908044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bdbbb-6bf3-4b3c-8b71-91e89447d299 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:57.939038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:57.987431 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563913a-e060-4f5d-a932-13709a9ea8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:57.988037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563913a-e060-4f5d-a932-13709a9ea8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:57.988310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563913a-e060-4f5d-a932-13709a9ea8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:57.988577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563913a-e060-4f5d-a932-13709a9ea8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:57.991397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2563913a-e060-4f5d-a932-13709a9ea8a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:58.104844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563913a-e060-4f5d-a932-13709a9ea8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:58.106279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563913a-e060-4f5d-a932-13709a9ea8a9 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:58.125883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 681/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:00.918523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f7b7-0b8d-4539-9e6a-a056d3a590ba None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:00.919065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f7b7-0b8d-4539-9e6a-a056d3a590ba None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:00.919065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f7b7-0b8d-4539-9e6a-a056d3a590ba None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:00.920527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 657/1338] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:00.926259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc37d-9ce1-4828-856b-e74b14a97dab None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:00.927171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc37d-9ce1-4828-856b-e74b14a97dab None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:00.927446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc37d-9ce1-4828-856b-e74b14a97dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:01.012709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-47fcc37d-9ce1-4828-856b-e74b14a97dab None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:01.013982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-47fcc37d-9ce1-4828-856b-e74b14a97dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:01.025075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:01.125903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 682/1339] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:17:01.172248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f7b7-0b8d-4539-9e6a-a056d3a590ba None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:01.173282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a8f2f7b7-0b8d-4539-9e6a-a056d3a590ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:01.295853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f7b7-0b8d-4539-9e6a-a056d3a590ba None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:01.370376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147feb2-df33-4586-8e64-a4942d6fb7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:01.371001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147feb2-df33-4586-8e64-a4942d6fb7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:01.371277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147feb2-df33-4586-8e64-a4942d6fb7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:01.371548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147feb2-df33-4586-8e64-a4942d6fb7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:01.373190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c147feb2-df33-4586-8e64-a4942d6fb7eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:01.413855 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:01.497677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147feb2-df33-4586-8e64-a4942d6fb7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:01.499058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147feb2-df33-4586-8e64-a4942d6fb7eb service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:01.519307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 658/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:05.901678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0c2a1-7b47-4da4-9e4a-7a357b97043f None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:05.902257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0c2a1-7b47-4da4-9e4a-7a357b97043f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:05.902257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0c2a1-7b47-4da4-9e4a-7a357b97043f None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:05.903825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 683/1341] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:05.911332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396da8df-32d4-4504-b97d-125bc91efa6b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:05.911870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396da8df-32d4-4504-b97d-125bc91efa6b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:05.911870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396da8df-32d4-4504-b97d-125bc91efa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:05.993941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-396da8df-32d4-4504-b97d-125bc91efa6b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:05.995216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-396da8df-32d4-4504-b97d-125bc91efa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:06.092188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:06.105184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 659/1342] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:06.146194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0c2a1-7b47-4da4-9e4a-7a357b97043f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:06.147801 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3cd0c2a1-7b47-4da4-9e4a-7a357b97043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:06.262825 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0c2a1-7b47-4da4-9e4a-7a357b97043f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:06.303473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:06.342454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f0fb3-aec3-4891-b689-be1ea8793b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:06.342971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f0fb3-aec3-4891-b689-be1ea8793b81 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:06.343242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f0fb3-aec3-4891-b689-be1ea8793b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:06.343506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f0fb3-aec3-4891-b689-be1ea8793b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:06.345119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-309f0fb3-aec3-4891-b689-be1ea8793b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:06.456686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f0fb3-aec3-4891-b689-be1ea8793b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:06.459092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f0fb3-aec3-4891-b689-be1ea8793b81 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:06.479136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 684/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:09.475788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7a176-4921-420f-ad81-4b61cd160fd0 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:09.476340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7a176-4921-420f-ad81-4b61cd160fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:09.476340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7a176-4921-420f-ad81-4b61cd160fd0 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:09.477634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 660/1344] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:09.483745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b29e-28fa-47a6-b1dd-b4935049456a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:09.484259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b29e-28fa-47a6-b1dd-b4935049456a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:09.484352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2b29e-28fa-47a6-b1dd-b4935049456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:09.560265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-1ba2b29e-28fa-47a6-b1dd-b4935049456a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:09.561553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1ba2b29e-28fa-47a6-b1dd-b4935049456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:09.581469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:09.665027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 685/1345] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:09.702734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7a176-4921-420f-ad81-4b61cd160fd0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:09.704312 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-25d7a176-4921-420f-ad81-4b61cd160fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:09.820685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7a176-4921-420f-ad81-4b61cd160fd0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:09.905436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a08e-fdbe-4625-bcda-de614831bf07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:09.906057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a08e-fdbe-4625-bcda-de614831bf07 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:09.906353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a08e-fdbe-4625-bcda-de614831bf07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:09.906630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a08e-fdbe-4625-bcda-de614831bf07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:09.908276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2d52a08e-fdbe-4625-bcda-de614831bf07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:09.955305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:10.026880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52a08e-fdbe-4625-bcda-de614831bf07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:10.028328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52a08e-fdbe-4625-bcda-de614831bf07 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:10.047563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 661/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:14.703007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99523-7cec-40b9-b8c4-007f1788046f None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:14.703544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99523-7cec-40b9-b8c4-007f1788046f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:14.703544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99523-7cec-40b9-b8c4-007f1788046f None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:14.705692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 686/1347] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:14.710710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec156e54-fdd9-4970-aa08-d62a29b8a523 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:14.711536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec156e54-fdd9-4970-aa08-d62a29b8a523 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:14.711536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec156e54-fdd9-4970-aa08-d62a29b8a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:14.790497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ec156e54-fdd9-4970-aa08-d62a29b8a523 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:14.791743 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ec156e54-fdd9-4970-aa08-d62a29b8a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:14.920642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:14.924789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 662/1348] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:14.962939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a99523-7cec-40b9-b8c4-007f1788046f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:14.964497 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b3a99523-7cec-40b9-b8c4-007f1788046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:15.079716 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a99523-7cec-40b9-b8c4-007f1788046f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:15.132433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:15.162670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6050e2-f27e-427c-891f-397ecb3908d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:15.163859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6050e2-f27e-427c-891f-397ecb3908d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:15.164134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6050e2-f27e-427c-891f-397ecb3908d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:15.164399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6050e2-f27e-427c-891f-397ecb3908d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:15.166213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8e6050e2-f27e-427c-891f-397ecb3908d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:15.289139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6050e2-f27e-427c-891f-397ecb3908d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:15.290648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6050e2-f27e-427c-891f-397ecb3908d1 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:15.311441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 687/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:20.544105 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73823fc-1ae6-4d1f-83a6-5f4656436e2f None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:20.544590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73823fc-1ae6-4d1f-83a6-5f4656436e2f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:20.544690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73823fc-1ae6-4d1f-83a6-5f4656436e2f None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:20.546252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 663/1350] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:20.551996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75beff-5571-4efd-8987-cd645b0fe3f3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:20.552499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75beff-5571-4efd-8987-cd645b0fe3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:20.552774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75beff-5571-4efd-8987-cd645b0fe3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:20.663948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9b75beff-5571-4efd-8987-cd645b0fe3f3 None None] MFA Rules not processed for user `448d43be14a74865a1e0d09e76c7e248`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:20.665229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9b75beff-5571-4efd-8987-cd645b0fe3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:20.710736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:20.839798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 688/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:17:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:25.061708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6338-aa0b-4bbe-ac6d-adeddcb5c136 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:25.062662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6338-aa0b-4bbe-ac6d-adeddcb5c136 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:25.063144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6338-aa0b-4bbe-ac6d-adeddcb5c136 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:25.064874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 664/1352] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:25.071740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb31c3-03cc-4598-84e7-5ec49f3f04c8 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:25.072310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb31c3-03cc-4598-84e7-5ec49f3f04c8 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:25.072655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb31c3-03cc-4598-84e7-5ec49f3f04c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:25.163956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-2ecb31c3-03cc-4598-84e7-5ec49f3f04c8 None None] MFA Rules not processed for user `448d43be14a74865a1e0d09e76c7e248`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:25.165468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2ecb31c3-03cc-4598-84e7-5ec49f3f04c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:25.252543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:25.304073 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 689/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:17:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:26.908049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52374e18-6b6a-405e-b69f-f1185edc60f4 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:26.908617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52374e18-6b6a-405e-b69f-f1185edc60f4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:26.908713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52374e18-6b6a-405e-b69f-f1185edc60f4 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:26.910551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 665/1354] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:26.916153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7182fef-c430-4a2c-8629-811ba7bec6a9 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:26.916686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7182fef-c430-4a2c-8629-811ba7bec6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:26.916820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7182fef-c430-4a2c-8629-811ba7bec6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:27.002560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c7182fef-c430-4a2c-8629-811ba7bec6a9 None None] MFA Rules not processed for user `448d43be14a74865a1e0d09e76c7e248`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:27.003846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c7182fef-c430-4a2c-8629-811ba7bec6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:27.119672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 690/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:17:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:17:30.479552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f54f4-7e48-450e-a0ed-b3dd19be28ee None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:30.480187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f54f4-7e48-450e-a0ed-b3dd19be28ee None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:30.480187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f54f4-7e48-450e-a0ed-b3dd19be28ee None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:30.481483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 666/1356] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:30.489881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf7e9-5868-420e-a01e-b2fdb795ea4c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:30.490380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf7e9-5868-420e-a01e-b2fdb795ea4c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:30.490707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf7e9-5868-420e-a01e-b2fdb795ea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:30.547289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:30.587747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-39abf7e9-5868-420e-a01e-b2fdb795ea4c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:30.589414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-39abf7e9-5868-420e-a01e-b2fdb795ea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:30.722152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 691/1357] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:30.778341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21b81-5da9-4faf-813e-c78c2cdb93c1 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:30.779089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21b81-5da9-4faf-813e-c78c2cdb93c1 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:30.779794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21b81-5da9-4faf-813e-c78c2cdb93c1 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:30.781946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 667/1358] 10.222.0.46 () {54 vars in 962 bytes} [Thu Aug 4 05:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:30.791004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2d5e3-f123-4040-b498-9d6f03b29802 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:30.791621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2d5e3-f123-4040-b498-9d6f03b29802 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:30.792865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2d5e3-f123-4040-b498-9d6f03b29802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:30.896872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-4ee2d5e3-f123-4040-b498-9d6f03b29802 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:30.898550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4ee2d5e3-f123-4040-b498-9d6f03b29802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:30.968914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:31.044917 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 692/1359] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Aug 4 05:17:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:17:31.054473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e21b81-5da9-4faf-813e-c78c2cdb93c1 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:31.056080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-90e21b81-5da9-4faf-813e-c78c2cdb93c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:31.231674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e21b81-5da9-4faf-813e-c78c2cdb93c1 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:31.312692 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:31.355805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab34ba-07b1-4f5b-9f31-240e29372e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:31.356518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab34ba-07b1-4f5b-9f31-240e29372e2e service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:31.356870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab34ba-07b1-4f5b-9f31-240e29372e2e service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:31.357216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab34ba-07b1-4f5b-9f31-240e29372e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:31.358951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-12ab34ba-07b1-4f5b-9f31-240e29372e2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:31.466694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab34ba-07b1-4f5b-9f31-240e29372e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:31.468418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab34ba-07b1-4f5b-9f31-240e29372e2e service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:31.494544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 668/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:33.782042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea0451-54ce-48bf-8ef5-528d448e8df8 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:33.782881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea0451-54ce-48bf-8ef5-528d448e8df8 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:33.782881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea0451-54ce-48bf-8ef5-528d448e8df8 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:33.784209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 693/1361] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:17:33.792243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf22e3-d60e-4d91-b58e-81727f085337 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:33.793033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf22e3-d60e-4d91-b58e-81727f085337 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:33.793033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf22e3-d60e-4d91-b58e-81727f085337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:34.001133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ccbf22e3-d60e-4d91-b58e-81727f085337 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:34.002606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ccbf22e3-d60e-4d91-b58e-81727f085337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:34.047147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:34.138613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 669/1362] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:34.220894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea0451-54ce-48bf-8ef5-528d448e8df8 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:34.223394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2fea0451-54ce-48bf-8ef5-528d448e8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:34.499421 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea0451-54ce-48bf-8ef5-528d448e8df8 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:34.514713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:34.652371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544cc3d-01c2-42f4-84a9-04a33a4c9454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:34.653027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544cc3d-01c2-42f4-84a9-04a33a4c9454 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:34.653302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544cc3d-01c2-42f4-84a9-04a33a4c9454 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:34.653569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544cc3d-01c2-42f4-84a9-04a33a4c9454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:34.655477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3544cc3d-01c2-42f4-84a9-04a33a4c9454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:34.764560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544cc3d-01c2-42f4-84a9-04a33a4c9454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:34.766200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544cc3d-01c2-42f4-84a9-04a33a4c9454 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:34.801340 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 694/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:37.491063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43fe1b-e836-4972-a841-40ff6cacdb4a None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.491908 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43fe1b-e836-4972-a841-40ff6cacdb4a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.492364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43fe1b-e836-4972-a841-40ff6cacdb4a None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.493909 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 670/1364] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:37.500107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aba581-46bf-4dcf-acc4-a4491795f704 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.500625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aba581-46bf-4dcf-acc4-a4491795f704 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.500709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aba581-46bf-4dcf-acc4-a4491795f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.523299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:37.617769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-d1aba581-46bf-4dcf-acc4-a4491795f704 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:37.619455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d1aba581-46bf-4dcf-acc4-a4491795f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:37.751305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 695/1365] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:37.801253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de828a2-f356-4767-bca3-88a9c3d57fff None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.801929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de828a2-f356-4767-bca3-88a9c3d57fff None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.802454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de828a2-f356-4767-bca3-88a9c3d57fff None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.804049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 671/1366] 10.222.0.46 () {54 vars in 962 bytes} [Thu Aug 4 05:17:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:37.810380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069da011-22c6-4b8d-bae0-0a15cf69c855 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.810671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069da011-22c6-4b8d-bae0-0a15cf69c855 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.810930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069da011-22c6-4b8d-bae0-0a15cf69c855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.908730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-069da011-22c6-4b8d-bae0-0a15cf69c855 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:37.910470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-069da011-22c6-4b8d-bae0-0a15cf69c855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:37.952084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:38.049059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 696/1367] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Aug 4 05:17:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:38.058181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de828a2-f356-4767-bca3-88a9c3d57fff None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:38.059847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7de828a2-f356-4767-bca3-88a9c3d57fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:38.244408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de828a2-f356-4767-bca3-88a9c3d57fff None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:38.270486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:38.389852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b671b-6494-4ed4-aef1-42faeaea4ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:38.390678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b671b-6494-4ed4-aef1-42faeaea4ae4 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.390958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b671b-6494-4ed4-aef1-42faeaea4ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.391232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b671b-6494-4ed4-aef1-42faeaea4ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.393194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-497b671b-6494-4ed4-aef1-42faeaea4ae4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:38.509290 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b671b-6494-4ed4-aef1-42faeaea4ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:38.511216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b671b-6494-4ed4-aef1-42faeaea4ae4 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:38.534934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 672/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:17:39.666898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c8c1-fc78-4d4c-b04c-23d47525caf0 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.667443 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c8c1-fc78-4d4c-b04c-23d47525caf0 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.667844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c8c1-fc78-4d4c-b04c-23d47525caf0 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.673890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 697/1369] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:39.679527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bfb50-d99a-4087-9b1a-4ba8d9127d3b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.680057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bfb50-d99a-4087-9b1a-4ba8d9127d3b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.680497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bfb50-d99a-4087-9b1a-4ba8d9127d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.719015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:39.759336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9f2bfb50-d99a-4087-9b1a-4ba8d9127d3b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:39.760718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9f2bfb50-d99a-4087-9b1a-4ba8d9127d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:39.878400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 673/1370] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:40.199623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345a84f-c850-4d7e-98cc-18afc31d296f None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.199905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345a84f-c850-4d7e-98cc-18afc31d296f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.200183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345a84f-c850-4d7e-98cc-18afc31d296f None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.201692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 698/1371] 10.222.0.46 () {54 vars in 964 bytes} [Thu Aug 4 05:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:40.207055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe186c-b53a-4b37-8c4b-d28bc48aaff5 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.207352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe186c-b53a-4b37-8c4b-d28bc48aaff5 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.207733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe186c-b53a-4b37-8c4b-d28bc48aaff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.307792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-49fe186c-b53a-4b37-8c4b-d28bc48aaff5 None None] MFA Rules not processed for user `600993aa29bc452f8658ed8cb426b470`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:40.309015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-49fe186c-b53a-4b37-8c4b-d28bc48aaff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:40.371984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:40.406354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 674/1372] 10.222.0.46 () {58 vars in 1061 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:40.415573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345a84f-c850-4d7e-98cc-18afc31d296f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.417415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6345a84f-c850-4d7e-98cc-18afc31d296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:40.539678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345a84f-c850-4d7e-98cc-18afc31d296f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.590122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:40.634965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7a572-b57d-4e0c-9eb5-11df2a46be33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.635718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7a572-b57d-4e0c-9eb5-11df2a46be33 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.636093 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7a572-b57d-4e0c-9eb5-11df2a46be33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.636492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7a572-b57d-4e0c-9eb5-11df2a46be33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.638576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-10c7a572-b57d-4e0c-9eb5-11df2a46be33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:40.800341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7a572-b57d-4e0c-9eb5-11df2a46be33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.802372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7a572-b57d-4e0c-9eb5-11df2a46be33 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.825162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 699/1373] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:40.954883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30ad1c-62b1-4393-93e9-ce75415f4826 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.955578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30ad1c-62b1-4393-93e9-ce75415f4826 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.955578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30ad1c-62b1-4393-93e9-ce75415f4826 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.957763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 675/1374] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:40.963680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af18cc-d71e-437a-a779-f370f7415688 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.964003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af18cc-d71e-437a-a779-f370f7415688 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.964314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af18cc-d71e-437a-a779-f370f7415688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.072899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-35af18cc-d71e-437a-a779-f370f7415688 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:41.074767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-35af18cc-d71e-437a-a779-f370f7415688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:41.103060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:41.213795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 700/1375] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:41.259589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30ad1c-62b1-4393-93e9-ce75415f4826 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.261241 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cd30ad1c-62b1-4393-93e9-ce75415f4826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:41.453903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30ad1c-62b1-4393-93e9-ce75415f4826 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.521907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:41.588930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091f5db-d7a2-44ad-9da0-50fc7d76d171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.589485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091f5db-d7a2-44ad-9da0-50fc7d76d171 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.589763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091f5db-d7a2-44ad-9da0-50fc7d76d171 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.590042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091f5db-d7a2-44ad-9da0-50fc7d76d171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.591708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d091f5db-d7a2-44ad-9da0-50fc7d76d171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:41.696091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091f5db-d7a2-44ad-9da0-50fc7d76d171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.697699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091f5db-d7a2-44ad-9da0-50fc7d76d171 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.718636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 676/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:44.054343 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d76d8e-7f0a-4ee2-b038-026a3fb7685d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:44.054940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d76d8e-7f0a-4ee2-b038-026a3fb7685d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:44.054940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d76d8e-7f0a-4ee2-b038-026a3fb7685d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:44.056508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 701/1377] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:44.061902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe398c-af95-4a79-b95c-b32f4615314f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:44.062420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe398c-af95-4a79-b95c-b32f4615314f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:44.062526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe398c-af95-4a79-b95c-b32f4615314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:44.146747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-44fe398c-af95-4a79-b95c-b32f4615314f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:44.147998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-44fe398c-af95-4a79-b95c-b32f4615314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:44.155797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:44.274167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 677/1378] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:44.322841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d76d8e-7f0a-4ee2-b038-026a3fb7685d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:44.324399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c6d76d8e-7f0a-4ee2-b038-026a3fb7685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:44.552369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d76d8e-7f0a-4ee2-b038-026a3fb7685d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:44.557745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:44.729441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5cc42-fe5a-4957-8404-beb265eec1fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:44.730232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5cc42-fe5a-4957-8404-beb265eec1fd service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:44.730584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5cc42-fe5a-4957-8404-beb265eec1fd service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:44.731023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5cc42-fe5a-4957-8404-beb265eec1fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:44.732932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e3a5cc42-fe5a-4957-8404-beb265eec1fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:44.933444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5cc42-fe5a-4957-8404-beb265eec1fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:44.936964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5cc42-fe5a-4957-8404-beb265eec1fd service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:44.990977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 702/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:17:47.589191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5380764-e15a-4c35-96e6-eea5b5ebcb66 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:47.589986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5380764-e15a-4c35-96e6-eea5b5ebcb66 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:47.589986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5380764-e15a-4c35-96e6-eea5b5ebcb66 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:47.591185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 678/1380] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:17:47.601489 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3ddf-7829-4286-b981-25c1378521e2 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:47.602362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3ddf-7829-4286-b981-25c1378521e2 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:47.602362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3ddf-7829-4286-b981-25c1378521e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:47.615628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:47.694168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-bdfa3ddf-7829-4286-b981-25c1378521e2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:47.695376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bdfa3ddf-7829-4286-b981-25c1378521e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:47.826213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 703/1381] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:17:47.876459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5380764-e15a-4c35-96e6-eea5b5ebcb66 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:47.881441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d5380764-e15a-4c35-96e6-eea5b5ebcb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:48.214987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:48.237154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5380764-e15a-4c35-96e6-eea5b5ebcb66 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:48.501465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e59d-be52-4025-ab29-369d8bc04771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:48.502469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e59d-be52-4025-ab29-369d8bc04771 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:48.502953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e59d-be52-4025-ab29-369d8bc04771 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:48.504106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e59d-be52-4025-ab29-369d8bc04771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:48.507570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0b88e59d-be52-4025-ab29-369d8bc04771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:48.701830 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88e59d-be52-4025-ab29-369d8bc04771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:48.705064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88e59d-be52-4025-ab29-369d8bc04771 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:48.727666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:48.751233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 679/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 875 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:51.261190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c86f9d-ffc3-4fd4-adfe-4ddacac723b0 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:51.261763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c86f9d-ffc3-4fd4-adfe-4ddacac723b0 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:51.261960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c86f9d-ffc3-4fd4-adfe-4ddacac723b0 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:51.264121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 704/1383] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:51.273689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3f924-908c-4362-a8cc-dd874ac0cfdb None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:51.274571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3f924-908c-4362-a8cc-dd874ac0cfdb None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:51.274787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3f924-908c-4362-a8cc-dd874ac0cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:51.367422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-31a3f924-908c-4362-a8cc-dd874ac0cfdb None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:51.368144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-31a3f924-908c-4362-a8cc-dd874ac0cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:51.508076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 680/1384] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:17:51.558252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c86f9d-ffc3-4fd4-adfe-4ddacac723b0 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:51.560749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d3c86f9d-ffc3-4fd4-adfe-4ddacac723b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:51.692784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:51.768758 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c86f9d-ffc3-4fd4-adfe-4ddacac723b0 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:51.917229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3c5df-ee0c-4fb4-9204-aa9656c60e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:51.917848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3c5df-ee0c-4fb4-9204-aa9656c60e78 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:51.918126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3c5df-ee0c-4fb4-9204-aa9656c60e78 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:51.918435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3c5df-ee0c-4fb4-9204-aa9656c60e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:51.920211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b8a3c5df-ee0c-4fb4-9204-aa9656c60e78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:51.986508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:52.039986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3c5df-ee0c-4fb4-9204-aa9656c60e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:52.041575 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3c5df-ee0c-4fb4-9204-aa9656c60e78 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:52.064336 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 705/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:54.260545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606ed3e-c5d9-49ef-9de7-cf0d20f94d3c None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:54.261120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606ed3e-c5d9-49ef-9de7-cf0d20f94d3c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:54.261120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606ed3e-c5d9-49ef-9de7-cf0d20f94d3c None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:54.262594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 681/1386] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:54.268753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a09b6-f7c9-4f3b-83a1-d8631e112af9 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:54.269932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a09b6-f7c9-4f3b-83a1-d8631e112af9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:54.269932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a09b6-f7c9-4f3b-83a1-d8631e112af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:54.351716 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-e09a09b6-f7c9-4f3b-83a1-d8631e112af9 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:54.353608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e09a09b6-f7c9-4f3b-83a1-d8631e112af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:54.496830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 706/1387] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:54.545247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606ed3e-c5d9-49ef-9de7-cf0d20f94d3c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:54.547042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b606ed3e-c5d9-49ef-9de7-cf0d20f94d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:54.658415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:54.793115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606ed3e-c5d9-49ef-9de7-cf0d20f94d3c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:54.979004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14460e76-402b-4407-b95a-a016d91ada22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:54.979641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14460e76-402b-4407-b95a-a016d91ada22 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:54.979915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14460e76-402b-4407-b95a-a016d91ada22 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:54.980190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14460e76-402b-4407-b95a-a016d91ada22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:54.981928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-14460e76-402b-4407-b95a-a016d91ada22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:55.041364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:55.110938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14460e76-402b-4407-b95a-a016d91ada22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:55.114336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14460e76-402b-4407-b95a-a016d91ada22 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:55.140702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 682/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:57.431042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c6cda-aac6-4caf-8a1a-2b08a3b8e0a1 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:57.431887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c6cda-aac6-4caf-8a1a-2b08a3b8e0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:57.431887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c6cda-aac6-4caf-8a1a-2b08a3b8e0a1 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:57.433545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 707/1389] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:57.440652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55931bfb-507a-48b2-b1f5-316dd236e8e2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:57.442050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55931bfb-507a-48b2-b1f5-316dd236e8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:57.442723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55931bfb-507a-48b2-b1f5-316dd236e8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:57.497605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccc486-1d9f-457b-8477-2e4268bb8357 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:57.498169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccc486-1d9f-457b-8477-2e4268bb8357 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:57.498726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccc486-1d9f-457b-8477-2e4268bb8357 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:57.502078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 708/1390] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:17:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:57.510647 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d12b4-35dd-40a6-b2ed-0f4d9232ed92 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:57.511112 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d12b4-35dd-40a6-b2ed-0f4d9232ed92 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:57.511588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d12b4-35dd-40a6-b2ed-0f4d9232ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:57.538202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-55931bfb-507a-48b2-b1f5-316dd236e8e2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:57.539664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-55931bfb-507a-48b2-b1f5-316dd236e8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:57.578594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:57.623639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-856d12b4-35dd-40a6-b2ed-0f4d9232ed92 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:57.624913 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-856d12b4-35dd-40a6-b2ed-0f4d9232ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:57.672888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 683/1391] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:17:57.743694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba2006-042e-41c9-be8e-25cef76424ab None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:57.744082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba2006-042e-41c9-be8e-25cef76424ab None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:57.744416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba2006-042e-41c9-be8e-25cef76424ab None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:57.745887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 684/1392] 10.222.0.46 () {54 vars in 966 bytes} [Thu Aug 4 05:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:17:57.755444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd7f4a-7751-4234-bff4-42f89faaed7a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:57.755726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd7f4a-7751-4234-bff4-42f89faaed7a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:57.755989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd7f4a-7751-4234-bff4-42f89faaed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:57.769873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 709/1393] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:57.777184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:57.818928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d12b4-35dd-40a6-b2ed-0f4d9232ed92 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:57.820559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-856d12b4-35dd-40a6-b2ed-0f4d9232ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:57.853546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c7fd7f4a-7751-4234-bff4-42f89faaed7a None None] MFA Rules not processed for user `9fc9a884f16149cda246ea9638621296`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:57.854985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c7fd7f4a-7751-4234-bff4-42f89faaed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:57.959466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 685/1394] 10.222.0.46 () {58 vars in 1063 bytes} [Thu Aug 4 05:17:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:17:57.962449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:57.969312 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd7f4a-7751-4234-bff4-42f89faaed7a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:57.973910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d12b4-35dd-40a6-b2ed-0f4d9232ed92 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:57.979153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd7f4a-7751-4234-bff4-42f89faaed7a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:58.073247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c6610-cb86-49f9-914e-03ed94322dea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc9a884f16149cda246ea9638621296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:58.073880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c6610-cb86-49f9-914e-03ed94322dea service glance] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:58.074156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c6610-cb86-49f9-914e-03ed94322dea service glance] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:58.074464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c6610-cb86-49f9-914e-03ed94322dea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:58.076250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-818c6610-cb86-49f9-914e-03ed94322dea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:58.111786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:58.115306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b58f0b-71aa-4bcb-b7b4-52824c45a5e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:58.116299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b58f0b-71aa-4bcb-b7b4-52824c45a5e3 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:58.116736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b58f0b-71aa-4bcb-b7b4-52824c45a5e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:58.117164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b58f0b-71aa-4bcb-b7b4-52824c45a5e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:58.120142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b8b58f0b-71aa-4bcb-b7b4-52824c45a5e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:58.224183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c6610-cb86-49f9-914e-03ed94322dea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:58.225573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c6610-cb86-49f9-914e-03ed94322dea service glance] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:58.231015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b58f0b-71aa-4bcb-b7b4-52824c45a5e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:58.232660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b58f0b-71aa-4bcb-b7b4-52824c45a5e3 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:58.247378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 686/1395] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:17:58.251860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:58.256346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 710/1396] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:17:59.360334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982d59f-80d2-4309-9253-3f62825ba181 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:59.361266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982d59f-80d2-4309-9253-3f62825ba181 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:59.361442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982d59f-80d2-4309-9253-3f62825ba181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:59.459846 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-7982d59f-80d2-4309-9253-3f62825ba181 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:59.461841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7982d59f-80d2-4309-9253-3f62825ba181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:59.583944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:59.592075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 687/1397] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:17:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:17:59.646732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b090c4-1028-4985-8361-05e71448892b None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:59.647637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b090c4-1028-4985-8361-05e71448892b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:59.647637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b090c4-1028-4985-8361-05e71448892b None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:59.649075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 711/1398] 10.222.0.46 () {54 vars in 943 bytes} [Thu Aug 4 05:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:59.657904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114178b-d817-4cd0-86ed-e1c4fb6a246a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:59.658336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114178b-d817-4cd0-86ed-e1c4fb6a246a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:59.658726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114178b-d817-4cd0-86ed-e1c4fb6a246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:59.764545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e114178b-d817-4cd0-86ed-e1c4fb6a246a None None] MFA Rules not processed for user `67ac376400a7466a8e01582efcb91f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:59.765787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e114178b-d817-4cd0-86ed-e1c4fb6a246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:59.931735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 688/1399] 10.222.0.46 () {58 vars in 1040 bytes} [Thu Aug 4 05:17:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:59.947654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b090c4-1028-4985-8361-05e71448892b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:59.949595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d0b090c4-1028-4985-8361-05e71448892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:00.150871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b090c4-1028-4985-8361-05e71448892b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:00.273768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:00.298172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87153e1e-d86c-46c7-a2bc-727fe1eb2f9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:00.298844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87153e1e-d86c-46c7-a2bc-727fe1eb2f9f service swift] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:00.299109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87153e1e-d86c-46c7-a2bc-727fe1eb2f9f service swift] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:00.299378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87153e1e-d86c-46c7-a2bc-727fe1eb2f9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:00.301897 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-87153e1e-d86c-46c7-a2bc-727fe1eb2f9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:00.565665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87153e1e-d86c-46c7-a2bc-727fe1eb2f9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:00.569434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87153e1e-d86c-46c7-a2bc-727fe1eb2f9f service swift] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:00.586017 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 712/1400] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:17:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:18:00.744044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8671f-1b39-4ddc-8988-02d173d1ad54 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:00.744888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8671f-1b39-4ddc-8988-02d173d1ad54 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:00.744888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8671f-1b39-4ddc-8988-02d173d1ad54 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:00.746049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 689/1401] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:18:00.752378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d444e-3261-42fc-9e44-94f24bf6c5e7 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:00.752969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d444e-3261-42fc-9e44-94f24bf6c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:00.752969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d444e-3261-42fc-9e44-94f24bf6c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:00.878965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-4a8d444e-3261-42fc-9e44-94f24bf6c5e7 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:00.883279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4a8d444e-3261-42fc-9e44-94f24bf6c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:00.985457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:01.020682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 713/1402] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:01.111415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8671f-1b39-4ddc-8988-02d173d1ad54 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:01.113419 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c8a8671f-1b39-4ddc-8988-02d173d1ad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:01.221393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:01.359767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8671f-1b39-4ddc-8988-02d173d1ad54 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:01.560530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb3d40-60be-48b6-907c-2a9e83003e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:01.561760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb3d40-60be-48b6-907c-2a9e83003e7a service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:01.562268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb3d40-60be-48b6-907c-2a9e83003e7a service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:01.563350 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb3d40-60be-48b6-907c-2a9e83003e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:01.567327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-61eb3d40-60be-48b6-907c-2a9e83003e7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:01.607575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:01.748210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb3d40-60be-48b6-907c-2a9e83003e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:01.749848 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb3d40-60be-48b6-907c-2a9e83003e7a service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:01.778638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 690/1403] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:04.515761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0541-bb10-4a90-a8be-7b29850736ce None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:04.515761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0541-bb10-4a90-a8be-7b29850736ce None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:04.515761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0541-bb10-4a90-a8be-7b29850736ce None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:04.515761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 714/1404] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:18:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:04.516801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a70fd-24ea-4f48-a82e-6066167dbc88 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:04.516801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a70fd-24ea-4f48-a82e-6066167dbc88 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:04.516801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a70fd-24ea-4f48-a82e-6066167dbc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:04.622332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-6b8a70fd-24ea-4f48-a82e-6066167dbc88 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:04.624682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6b8a70fd-24ea-4f48-a82e-6066167dbc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:04.764066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:04.775512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 691/1405] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:04.830963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0541-bb10-4a90-a8be-7b29850736ce None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:04.833741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-700a0541-bb10-4a90-a8be-7b29850736ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:05.047553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0541-bb10-4a90-a8be-7b29850736ce None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:05.146766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:05.259553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e7c70-301c-4c93-b973-ac3ac24f3068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:05.260173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e7c70-301c-4c93-b973-ac3ac24f3068 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:05.260464 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e7c70-301c-4c93-b973-ac3ac24f3068 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:05.260734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e7c70-301c-4c93-b973-ac3ac24f3068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:05.262428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-312e7c70-301c-4c93-b973-ac3ac24f3068 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:05.428172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e7c70-301c-4c93-b973-ac3ac24f3068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:05.430037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e7c70-301c-4c93-b973-ac3ac24f3068 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:05.462570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 715/1406] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:09.262728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2f848-4f24-4851-9bf6-d98fd0e0c4a9 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:09.262728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2f848-4f24-4851-9bf6-d98fd0e0c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:09.262728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2f848-4f24-4851-9bf6-d98fd0e0c4a9 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:09.262728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 692/1407] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:18:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:18:09.267370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7756ecd-7992-43b9-8673-9306e9cc674d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:09.268180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7756ecd-7992-43b9-8673-9306e9cc674d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:09.268180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7756ecd-7992-43b9-8673-9306e9cc674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:09.370886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-d7756ecd-7992-43b9-8673-9306e9cc674d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:09.372759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d7756ecd-7992-43b9-8673-9306e9cc674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:09.416447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:09.602922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 716/1408] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:09.659930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2f848-4f24-4851-9bf6-d98fd0e0c4a9 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:09.663776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4bb2f848-4f24-4851-9bf6-d98fd0e0c4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:09.932211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2f848-4f24-4851-9bf6-d98fd0e0c4a9 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:10.073970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:10.192863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66669f6-2a4c-49da-a8b1-dc3ea1de3ecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:10.193644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66669f6-2a4c-49da-a8b1-dc3ea1de3ecb service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:10.193930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66669f6-2a4c-49da-a8b1-dc3ea1de3ecb service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:10.194237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66669f6-2a4c-49da-a8b1-dc3ea1de3ecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:10.195996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f66669f6-2a4c-49da-a8b1-dc3ea1de3ecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:10.361428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66669f6-2a4c-49da-a8b1-dc3ea1de3ecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:10.364769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66669f6-2a4c-49da-a8b1-dc3ea1de3ecb service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:10.401779 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 693/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:19.598545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=37 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:20.395069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=65 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:27.695556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9764f0-c71d-483c-97cf-9000a24258c3 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:27.696176 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9764f0-c71d-483c-97cf-9000a24258c3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:27.696176 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9764f0-c71d-483c-97cf-9000a24258c3 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:27.697508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 717/1410] 10.222.0.46 () {54 vars in 918 bytes} [Thu Aug 4 05:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:18:27.703407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18ba31-1432-4c8f-8c86-89a61fd8f453 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:27.704070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18ba31-1432-4c8f-8c86-89a61fd8f453 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:27.704070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18ba31-1432-4c8f-8c86-89a61fd8f453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:27.795679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8f18ba31-1432-4c8f-8c86-89a61fd8f453 None None] MFA Rules not processed for user `448d43be14a74865a1e0d09e76c7e248`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:27.796913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8f18ba31-1432-4c8f-8c86-89a61fd8f453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:27.936423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 694/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Aug 4 05:18:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:27.953749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662935-5859-4688-b91f-fc9eddd2fcee None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:27.954235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662935-5859-4688-b91f-fc9eddd2fcee None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:27.954757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662935-5859-4688-b91f-fc9eddd2fcee None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:27.957686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 718/1412] 10.222.0.46 () {54 vars in 918 bytes} [Thu Aug 4 05:18:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:27.963508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad19b-3c36-40a6-9683-3d9d441aad4a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:27.963788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad19b-3c36-40a6-9683-3d9d441aad4a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:27.964056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad19b-3c36-40a6-9683-3d9d441aad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:28.057072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:28.061296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-cc2ad19b-3c36-40a6-9683-3d9d441aad4a None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:28.062585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cc2ad19b-3c36-40a6-9683-3d9d441aad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:28.200238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 695/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Aug 4 05:18:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:30.867639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4485b1-b1c1-4c43-a803-0a0c0046841d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.868218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4485b1-b1c1-4c43-a803-0a0c0046841d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.868218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4485b1-b1c1-4c43-a803-0a0c0046841d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.869475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 719/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:30.875846 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f41f1-d793-4244-a474-f857a0de635b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.876657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f41f1-d793-4244-a474-f857a0de635b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.876657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f41f1-d793-4244-a474-f857a0de635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.953785 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-df9f41f1-d793-4244-a474-f857a0de635b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:30.955043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-df9f41f1-d793-4244-a474-f857a0de635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:31.014988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:31.084841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 696/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:31.131468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4485b1-b1c1-4c43-a803-0a0c0046841d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:31.132988 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-da4485b1-b1c1-4c43-a803-0a0c0046841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:31.308718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4485b1-b1c1-4c43-a803-0a0c0046841d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:31.394493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:31.471001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2023b-baf1-4c8e-90cc-295de022ad32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:31.472493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2023b-baf1-4c8e-90cc-295de022ad32 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.473020 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2023b-baf1-4c8e-90cc-295de022ad32 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.473486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2023b-baf1-4c8e-90cc-295de022ad32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.476765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e3f2023b-baf1-4c8e-90cc-295de022ad32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:31.629628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2023b-baf1-4c8e-90cc-295de022ad32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:31.631392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2023b-baf1-4c8e-90cc-295de022ad32 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:31.652311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 720/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:32.618779 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d5fc-d6c9-43c1-9d69-6f73f00086e3 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.619394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d5fc-d6c9-43c1-9d69-6f73f00086e3 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.619394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d5fc-d6c9-43c1-9d69-6f73f00086e3 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.620926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 697/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:32.626875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c6895-0f6f-493b-b113-692fdbeff66a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.627702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c6895-0f6f-493b-b113-692fdbeff66a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.627702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c6895-0f6f-493b-b113-692fdbeff66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.723781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-928c6895-0f6f-493b-b113-692fdbeff66a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:32.725021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-928c6895-0f6f-493b-b113-692fdbeff66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:32.754572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:32.839075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 721/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:32.995001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d5fc-d6c9-43c1-9d69-6f73f00086e3 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:32.996517 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-fe56d5fc-d6c9-43c1-9d69-6f73f00086e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:33.160871 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d5fc-d6c9-43c1-9d69-6f73f00086e3 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:33.212649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:33.336736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d88c3-3dd5-44da-ab70-1698157206f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:33.337356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d88c3-3dd5-44da-ab70-1698157206f3 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:33.337627 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d88c3-3dd5-44da-ab70-1698157206f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:33.337896 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d88c3-3dd5-44da-ab70-1698157206f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:33.339712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-584d88c3-3dd5-44da-ab70-1698157206f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:33.448424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d88c3-3dd5-44da-ab70-1698157206f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:33.450055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d88c3-3dd5-44da-ab70-1698157206f3 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:33.471062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 698/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:34.417187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4120-aa73-4e9f-95fa-6163140f2445 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:34.418524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4120-aa73-4e9f-95fa-6163140f2445 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:34.418524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4120-aa73-4e9f-95fa-6163140f2445 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:34.419249 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 722/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:34.425369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78d13e-1cc8-4d34-8ba8-a8195f2ec33a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:34.425905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78d13e-1cc8-4d34-8ba8-a8195f2ec33a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:34.426002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78d13e-1cc8-4d34-8ba8-a8195f2ec33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:34.486549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:34.512468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-6a78d13e-1cc8-4d34-8ba8-a8195f2ec33a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:34.513742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6a78d13e-1cc8-4d34-8ba8-a8195f2ec33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:34.623648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 699/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:34.781283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f4120-aa73-4e9f-95fa-6163140f2445 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:34.782959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-fd7f4120-aa73-4e9f-95fa-6163140f2445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:34.962265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f4120-aa73-4e9f-95fa-6163140f2445 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:34.977643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:35.095696 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27eeba2-15ec-4e24-b359-a8b60b658636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:35.096224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eeba2-15ec-4e24-b359-a8b60b658636 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:35.096607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eeba2-15ec-4e24-b359-a8b60b658636 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:35.096878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eeba2-15ec-4e24-b359-a8b60b658636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:35.098663 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b27eeba2-15ec-4e24-b359-a8b60b658636 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:35.210089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27eeba2-15ec-4e24-b359-a8b60b658636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:35.211818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27eeba2-15ec-4e24-b359-a8b60b658636 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:35.232964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 723/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:36.173826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6becc-591c-433d-949a-be4118ebd177 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:36.174378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6becc-591c-433d-949a-be4118ebd177 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:36.176044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6becc-591c-433d-949a-be4118ebd177 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:36.178754 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 700/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:18:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:36.184599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec82c-38d0-4b04-b142-4e54eb77bf1f None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:36.185209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec82c-38d0-4b04-b142-4e54eb77bf1f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:36.185209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec82c-38d0-4b04-b142-4e54eb77bf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:36.207799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:36.276226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ad6ec82c-38d0-4b04-b142-4e54eb77bf1f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:36.277666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ad6ec82c-38d0-4b04-b142-4e54eb77bf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:36.388667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 724/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:36.544758 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6becc-591c-433d-949a-be4118ebd177 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:36.546353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-09f6becc-591c-433d-949a-be4118ebd177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:36.681401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:36.724048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6becc-591c-433d-949a-be4118ebd177 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:36.859527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eb168-0fc0-41d4-a71f-2c2e99cc2974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:36.860035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eb168-0fc0-41d4-a71f-2c2e99cc2974 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:36.860318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eb168-0fc0-41d4-a71f-2c2e99cc2974 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:36.860588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eb168-0fc0-41d4-a71f-2c2e99cc2974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:36.862511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-592eb168-0fc0-41d4-a71f-2c2e99cc2974 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:36.959808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:36.973674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eb168-0fc0-41d4-a71f-2c2e99cc2974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:36.975351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eb168-0fc0-41d4-a71f-2c2e99cc2974 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:36.995951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 701/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:37.909533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdba4ac-2a6c-410b-9508-41817a3f60b0 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.910405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdba4ac-2a6c-410b-9508-41817a3f60b0 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.910553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdba4ac-2a6c-410b-9508-41817a3f60b0 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:37.913359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 725/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:18:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:37.921133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef730a80-400b-4de6-8bd6-26180539f77b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.921988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef730a80-400b-4de6-8bd6-26180539f77b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.921988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef730a80-400b-4de6-8bd6-26180539f77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.030578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ef730a80-400b-4de6-8bd6-26180539f77b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:38.031829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ef730a80-400b-4de6-8bd6-26180539f77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:38.140835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 702/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:38.300313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdba4ac-2a6c-410b-9508-41817a3f60b0 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.302578 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ecdba4ac-2a6c-410b-9508-41817a3f60b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:38.392043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:38.456820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdba4ac-2a6c-410b-9508-41817a3f60b0 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.597302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f03987-7ca0-44b7-ae23-72f1f85ab991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:38.598113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f03987-7ca0-44b7-ae23-72f1f85ab991 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.598422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f03987-7ca0-44b7-ae23-72f1f85ab991 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.598684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f03987-7ca0-44b7-ae23-72f1f85ab991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.600373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-60f03987-7ca0-44b7-ae23-72f1f85ab991 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:38.663881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:38.719254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f03987-7ca0-44b7-ae23-72f1f85ab991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:38.720776 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f03987-7ca0-44b7-ae23-72f1f85ab991 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:38.743266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 726/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:39.725266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36408f61-ace1-43d7-8680-158b798f9def None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.725826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36408f61-ace1-43d7-8680-158b798f9def None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.725826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36408f61-ace1-43d7-8680-158b798f9def None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.727210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 703/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:39.732639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbeadf-6890-4219-8533-be9a13635cf5 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.733090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbeadf-6890-4219-8533-be9a13635cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.733170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbeadf-6890-4219-8533-be9a13635cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.818539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f0bbeadf-6890-4219-8533-be9a13635cf5 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:39.819766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f0bbeadf-6890-4219-8533-be9a13635cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:39.930449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 727/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:40.087978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36408f61-ace1-43d7-8680-158b798f9def None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.089449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-36408f61-ace1-43d7-8680-158b798f9def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:40.148023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:40.266995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36408f61-ace1-43d7-8680-158b798f9def None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.394188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770c6f4-490b-4a47-8c19-3dd5e7be097f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.394843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770c6f4-490b-4a47-8c19-3dd5e7be097f service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.395115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770c6f4-490b-4a47-8c19-3dd5e7be097f service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.395385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770c6f4-490b-4a47-8c19-3dd5e7be097f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.397090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3770c6f4-490b-4a47-8c19-3dd5e7be097f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:40.404850 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:40.519779 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770c6f4-490b-4a47-8c19-3dd5e7be097f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.521400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770c6f4-490b-4a47-8c19-3dd5e7be097f service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.543169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 704/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:41.461664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f39d-c90f-4b37-8c84-fee2304bcc8d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.462190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f39d-c90f-4b37-8c84-fee2304bcc8d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.462190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f39d-c90f-4b37-8c84-fee2304bcc8d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.463516 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 728/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:41.469864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ac4d9-3d60-42a9-bda8-6ba300b6cd8a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.470484 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ac4d9-3d60-42a9-bda8-6ba300b6cd8a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.470484 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ac4d9-3d60-42a9-bda8-6ba300b6cd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.561014 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-5d9ac4d9-3d60-42a9-bda8-6ba300b6cd8a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:41.562248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5d9ac4d9-3d60-42a9-bda8-6ba300b6cd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:41.640971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:41.682676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 705/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:41.844492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633f39d-c90f-4b37-8c84-fee2304bcc8d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.845983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b633f39d-c90f-4b37-8c84-fee2304bcc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:41.867515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:42.022439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633f39d-c90f-4b37-8c84-fee2304bcc8d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:42.119360 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:42.147310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a16914-3142-46ff-9b70-00052eeca953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:42.148008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16914-3142-46ff-9b70-00052eeca953 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:42.148565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16914-3142-46ff-9b70-00052eeca953 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:42.149180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16914-3142-46ff-9b70-00052eeca953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:42.150956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e0a16914-3142-46ff-9b70-00052eeca953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:42.263901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a16914-3142-46ff-9b70-00052eeca953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:42.265487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a16914-3142-46ff-9b70-00052eeca953 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:42.287450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 729/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:43.227498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc6a4-0c4b-4281-870f-9f24490b0ea0 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:43.228106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc6a4-0c4b-4281-870f-9f24490b0ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:43.228451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc6a4-0c4b-4281-870f-9f24490b0ea0 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:43.230933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 706/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:18:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:43.239198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8567e4a-667c-44b7-8367-61d613de9bf0 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:43.239764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8567e4a-667c-44b7-8367-61d613de9bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:43.239877 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8567e4a-667c-44b7-8367-61d613de9bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:43.341529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a8567e4a-667c-44b7-8367-61d613de9bf0 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:43.342890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a8567e4a-667c-44b7-8367-61d613de9bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:43.397997 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:43.467222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 730/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:43.715227 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fc6a4-0c4b-4281-870f-9f24490b0ea0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:43.716823 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-901fc6a4-0c4b-4281-870f-9f24490b0ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:43.911011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fc6a4-0c4b-4281-870f-9f24490b0ea0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:43.978586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:44.047959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a64392-1a3c-412c-bc67-942763e7e1c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:44.048685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64392-1a3c-412c-bc67-942763e7e1c3 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:44.049012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64392-1a3c-412c-bc67-942763e7e1c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:44.049329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64392-1a3c-412c-bc67-942763e7e1c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:44.052247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c6a64392-1a3c-412c-bc67-942763e7e1c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:44.162801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a64392-1a3c-412c-bc67-942763e7e1c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:44.164441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a64392-1a3c-412c-bc67-942763e7e1c3 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:44.187625 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 707/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:45.094511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423c886-f6ad-49bd-80fc-ae550dae7baf None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.095089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423c886-f6ad-49bd-80fc-ae550dae7baf None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.095089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423c886-f6ad-49bd-80fc-ae550dae7baf None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.096620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 731/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:45.103257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8201d-a39d-4eb8-8d96-8e22355dcd5b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.103842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8201d-a39d-4eb8-8d96-8e22355dcd5b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.103842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8201d-a39d-4eb8-8d96-8e22355dcd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.193469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-2cd8201d-a39d-4eb8-8d96-8e22355dcd5b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:45.194768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2cd8201d-a39d-4eb8-8d96-8e22355dcd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.197122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:45.310941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 708/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:45.466389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423c886-f6ad-49bd-80fc-ae550dae7baf None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:45.467956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7423c886-f6ad-49bd-80fc-ae550dae7baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.637349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423c886-f6ad-49bd-80fc-ae550dae7baf None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:45.669706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:45.772750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2b35e-00ae-4d5e-8229-239d10104310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:45.773356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b35e-00ae-4d5e-8229-239d10104310 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.773672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b35e-00ae-4d5e-8229-239d10104310 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.773994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b35e-00ae-4d5e-8229-239d10104310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.775881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-dcb2b35e-00ae-4d5e-8229-239d10104310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.881989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2b35e-00ae-4d5e-8229-239d10104310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:45.883756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2b35e-00ae-4d5e-8229-239d10104310 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:45.906261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 732/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:47.964669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c6844-da65-4478-b15e-31a590088495 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.965318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c6844-da65-4478-b15e-31a590088495 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.965318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c6844-da65-4478-b15e-31a590088495 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.966667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 709/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:18:47.972985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e854-943f-4e96-8d19-4a0e9b64bf46 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.973888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e854-943f-4e96-8d19-4a0e9b64bf46 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.973888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e854-943f-4e96-8d19-4a0e9b64bf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.018383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:48.045680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ab38e854-943f-4e96-8d19-4a0e9b64bf46 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:48.046957 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ab38e854-943f-4e96-8d19-4a0e9b64bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:48.157435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 733/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:48.200069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c6844-da65-4478-b15e-31a590088495 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:48.201624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-339c6844-da65-4478-b15e-31a590088495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:48.322715 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c6844-da65-4478-b15e-31a590088495 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:48.359459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:48.421586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427867e-9130-4c56-9009-7078374b5bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:48.422218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427867e-9130-4c56-9009-7078374b5bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:48.422562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427867e-9130-4c56-9009-7078374b5bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:48.422840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427867e-9130-4c56-9009-7078374b5bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.424554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2427867e-9130-4c56-9009-7078374b5bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:48.548914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427867e-9130-4c56-9009-7078374b5bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:48.550947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427867e-9130-4c56-9009-7078374b5bb8 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:48.572789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 710/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:51.125739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b547c-1e1d-4e3c-8ea7-071ba91aeece None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.126712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b547c-1e1d-4e3c-8ea7-071ba91aeece None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.126712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b547c-1e1d-4e3c-8ea7-071ba91aeece None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.129225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 734/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:18:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:51.135456 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f503d8-f614-4a41-ba08-d39e0e6d89ab None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.136053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f503d8-f614-4a41-ba08-d39e0e6d89ab None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.136053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f503d8-f614-4a41-ba08-d39e0e6d89ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.212751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-00f503d8-f614-4a41-ba08-d39e0e6d89ab None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:51.214363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-00f503d8-f614-4a41-ba08-d39e0e6d89ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:51.232882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:51.341523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 711/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:51.384737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b547c-1e1d-4e3c-8ea7-071ba91aeece None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:51.387594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9f8b547c-1e1d-4e3c-8ea7-071ba91aeece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:51.533557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b547c-1e1d-4e3c-8ea7-071ba91aeece None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.550357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:51.622042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5ad51-99ee-4a4c-9d5a-b0c34b75fc2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.622948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ad51-99ee-4a4c-9d5a-b0c34b75fc2c service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.623420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ad51-99ee-4a4c-9d5a-b0c34b75fc2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.623753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ad51-99ee-4a4c-9d5a-b0c34b75fc2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.625894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d5e5ad51-99ee-4a4c-9d5a-b0c34b75fc2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:51.759059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5ad51-99ee-4a4c-9d5a-b0c34b75fc2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.760424 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5ad51-99ee-4a4c-9d5a-b0c34b75fc2c service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:51.782610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 735/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:54.426242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf0a0c-722c-4500-9686-efe4f703fb3b None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:54.426860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf0a0c-722c-4500-9686-efe4f703fb3b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:54.426860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf0a0c-722c-4500-9686-efe4f703fb3b None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:54.428105 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 712/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:54.433794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16274-0b12-4fef-b510-0968b41b657d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:54.434366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16274-0b12-4fef-b510-0968b41b657d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:54.434366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16274-0b12-4fef-b510-0968b41b657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:54.486564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:54.513374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-5fd16274-0b12-4fef-b510-0968b41b657d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:54.514646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5fd16274-0b12-4fef-b510-0968b41b657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:54.622828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 736/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:54.665711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf0a0c-722c-4500-9686-efe4f703fb3b None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:54.667298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c8bf0a0c-722c-4500-9686-efe4f703fb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:54.783779 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf0a0c-722c-4500-9686-efe4f703fb3b None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:54.826408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:54.879905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c6396-8efc-4d9c-bcba-3356f68a33d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:54.881004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6396-8efc-4d9c-bcba-3356f68a33d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:54.881505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6396-8efc-4d9c-bcba-3356f68a33d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:54.882000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c6396-8efc-4d9c-bcba-3356f68a33d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:54.885057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c69c6396-8efc-4d9c-bcba-3356f68a33d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:55.057529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c6396-8efc-4d9c-bcba-3356f68a33d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:55.059240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c6396-8efc-4d9c-bcba-3356f68a33d7 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:55.080573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 713/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:57.342548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24d01b-1a11-4e4c-a8e7-04c5c57a21a8 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.343123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24d01b-1a11-4e4c-a8e7-04c5c57a21a8 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.343123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24d01b-1a11-4e4c-a8e7-04c5c57a21a8 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.344492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 737/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:57.351617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179553d-863f-4493-8ca6-daa38e0a756e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.352178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179553d-863f-4493-8ca6-daa38e0a756e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.352178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179553d-863f-4493-8ca6-daa38e0a756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.430323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-1179553d-863f-4493-8ca6-daa38e0a756e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:57.431493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1179553d-863f-4493-8ca6-daa38e0a756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:57.454082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:57.577072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 714/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:57.618291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24d01b-1a11-4e4c-a8e7-04c5c57a21a8 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:57.619923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0f24d01b-1a11-4e4c-a8e7-04c5c57a21a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:57.743938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24d01b-1a11-4e4c-a8e7-04c5c57a21a8 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:57.765670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:57.827908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7382-e9fa-4547-bf85-74c55ae5776a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:57.828530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7382-e9fa-4547-bf85-74c55ae5776a service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.828805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7382-e9fa-4547-bf85-74c55ae5776a service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.829069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7382-e9fa-4547-bf85-74c55ae5776a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.830803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-fd7e7382-e9fa-4547-bf85-74c55ae5776a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:57.993246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7382-e9fa-4547-bf85-74c55ae5776a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:57.996110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e7382-e9fa-4547-bf85-74c55ae5776a service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.030563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 738/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:00.309393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4974-a98d-46c4-9094-b5e9335a5956 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:00.309982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4974-a98d-46c4-9094-b5e9335a5956 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:00.310345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4974-a98d-46c4-9094-b5e9335a5956 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:00.312074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 715/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:19:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:19:00.318392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bf7c3-a1c6-4d66-a1b9-975e33f39838 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:00.318975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bf7c3-a1c6-4d66-a1b9-975e33f39838 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:00.318975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bf7c3-a1c6-4d66-a1b9-975e33f39838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:00.399025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:00.402121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-170bf7c3-a1c6-4d66-a1b9-975e33f39838 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:00.403388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-170bf7c3-a1c6-4d66-a1b9-975e33f39838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:00.541638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 739/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:00.601178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c4974-a98d-46c4-9094-b5e9335a5956 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:00.603046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-820c4974-a98d-46c4-9094-b5e9335a5956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:00.727109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c4974-a98d-46c4-9094-b5e9335a5956 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:00.792009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:00.820690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce1f54-259a-45d0-b21c-2d5a438b9742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:00.821325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce1f54-259a-45d0-b21c-2d5a438b9742 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:00.821598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce1f54-259a-45d0-b21c-2d5a438b9742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:00.821873 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce1f54-259a-45d0-b21c-2d5a438b9742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:00.823616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b8ce1f54-259a-45d0-b21c-2d5a438b9742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:00.961845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce1f54-259a-45d0-b21c-2d5a438b9742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:00.963680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce1f54-259a-45d0-b21c-2d5a438b9742 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:00.985400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 716/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:03.336277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27c9e-1979-4ab2-a309-f96e605141f8 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:03.336803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27c9e-1979-4ab2-a309-f96e605141f8 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:03.336803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27c9e-1979-4ab2-a309-f96e605141f8 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:03.338108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 740/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:19:03.343922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1618-73ea-4eb2-8f2c-e7aa7ae8fb4d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:03.344514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1618-73ea-4eb2-8f2c-e7aa7ae8fb4d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:03.344514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1618-73ea-4eb2-8f2c-e7aa7ae8fb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:03.423579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-4efb1618-73ea-4eb2-8f2c-e7aa7ae8fb4d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:03.424814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4efb1618-73ea-4eb2-8f2c-e7aa7ae8fb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:03.459969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:03.546761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 717/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:03.586983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27c9e-1979-4ab2-a309-f96e605141f8 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:03.588428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-37c27c9e-1979-4ab2-a309-f96e605141f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:03.716365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27c9e-1979-4ab2-a309-f96e605141f8 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:03.750860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:03.824349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c04267-d81f-4b4d-a609-91473d876a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:03.824968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c04267-d81f-4b4d-a609-91473d876a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:03.825245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c04267-d81f-4b4d-a609-91473d876a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:03.825515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c04267-d81f-4b4d-a609-91473d876a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:03.827186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-70c04267-d81f-4b4d-a609-91473d876a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:03.952070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c04267-d81f-4b4d-a609-91473d876a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:03.953597 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c04267-d81f-4b4d-a609-91473d876a60 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:03.974071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 741/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:06.249731 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e158db-54af-4ea3-848d-f99d2c4802c8 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.250282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e158db-54af-4ea3-848d-f99d2c4802c8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.250282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e158db-54af-4ea3-848d-f99d2c4802c8 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.251861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 718/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:19:06.258160 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2958-8ee7-420f-8da2-4d6f4edfdecb None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.258754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2958-8ee7-420f-8da2-4d6f4edfdecb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.258754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff2958-8ee7-420f-8da2-4d6f4edfdecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.339185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-bfff2958-8ee7-420f-8da2-4d6f4edfdecb None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:06.340412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bfff2958-8ee7-420f-8da2-4d6f4edfdecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.350235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:06.448683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 742/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:06.488519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e158db-54af-4ea3-848d-f99d2c4802c8 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:06.491034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c9e158db-54af-4ea3-848d-f99d2c4802c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.625646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e158db-54af-4ea3-848d-f99d2c4802c8 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.704203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:06.726536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a78887-6fbd-4704-ae78-a33ac8c38ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.727171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a78887-6fbd-4704-ae78-a33ac8c38ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.727455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a78887-6fbd-4704-ae78-a33ac8c38ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.727726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a78887-6fbd-4704-ae78-a33ac8c38ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.729436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b5a78887-6fbd-4704-ae78-a33ac8c38ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.866220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a78887-6fbd-4704-ae78-a33ac8c38ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:06.867972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a78887-6fbd-4704-ae78-a33ac8c38ae5 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:06.891997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 719/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:09.071226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb3da2-8f5e-43d0-9f7a-bab6e4130505 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:09.071921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb3da2-8f5e-43d0-9f7a-bab6e4130505 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:09.071921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb3da2-8f5e-43d0-9f7a-bab6e4130505 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:09.073181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 743/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:19:09.079509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a346f8a-30f5-49f4-8c03-5a0a09ba1e7d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:09.080127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a346f8a-30f5-49f4-8c03-5a0a09ba1e7d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:09.080127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a346f8a-30f5-49f4-8c03-5a0a09ba1e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:09.167490 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-5a346f8a-30f5-49f4-8c03-5a0a09ba1e7d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:09.168745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5a346f8a-30f5-49f4-8c03-5a0a09ba1e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:09.216412 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:09.291226 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 720/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:09.331868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb3da2-8f5e-43d0-9f7a-bab6e4130505 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:09.334086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-87cb3da2-8f5e-43d0-9f7a-bab6e4130505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:09.453755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb3da2-8f5e-43d0-9f7a-bab6e4130505 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:09.500686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:09.543216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd65707-c10b-4feb-bc1f-ae500722f4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:09.543836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd65707-c10b-4feb-bc1f-ae500722f4de service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:09.544108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd65707-c10b-4feb-bc1f-ae500722f4de service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:09.544374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd65707-c10b-4feb-bc1f-ae500722f4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:09.546080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3bd65707-c10b-4feb-bc1f-ae500722f4de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:09.671440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd65707-c10b-4feb-bc1f-ae500722f4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:09.672918 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd65707-c10b-4feb-bc1f-ae500722f4de service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:09.695091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 744/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:11.917342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587693b5-fc7b-4270-8ab6-0f44992e1027 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:11.918082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587693b5-fc7b-4270-8ab6-0f44992e1027 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:11.918082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587693b5-fc7b-4270-8ab6-0f44992e1027 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:11.919332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 721/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:19:11.925845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002f7fe-4216-4ae4-bd2b-f63ccfa663d2 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:11.926713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002f7fe-4216-4ae4-bd2b-f63ccfa663d2 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:11.926713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002f7fe-4216-4ae4-bd2b-f63ccfa663d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:12.028625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-8002f7fe-4216-4ae4-bd2b-f63ccfa663d2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:12.029858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8002f7fe-4216-4ae4-bd2b-f63ccfa663d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:12.052972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:12.153122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 745/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:12.194571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587693b5-fc7b-4270-8ab6-0f44992e1027 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:12.196143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-587693b5-fc7b-4270-8ab6-0f44992e1027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:12.328373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587693b5-fc7b-4270-8ab6-0f44992e1027 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:12.429238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:12.437539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964be9c2-0c08-4076-9eba-5c3af7fbf9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:12.438461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be9c2-0c08-4076-9eba-5c3af7fbf9bd service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:12.438839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be9c2-0c08-4076-9eba-5c3af7fbf9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:12.444686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be9c2-0c08-4076-9eba-5c3af7fbf9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:12.444686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-964be9c2-0c08-4076-9eba-5c3af7fbf9bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:12.600094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964be9c2-0c08-4076-9eba-5c3af7fbf9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:12.601600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964be9c2-0c08-4076-9eba-5c3af7fbf9bd service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:12.622324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 722/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:14.794624 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f3ed-92cd-481e-bd8b-4922d5e60fab None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:14.795331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f3ed-92cd-481e-bd8b-4922d5e60fab None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:14.795331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f3ed-92cd-481e-bd8b-4922d5e60fab None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:14.796860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 746/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:19:14.804846 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2812-8f3e-4624-9db7-c0da68a69f7b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:14.805438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2812-8f3e-4624-9db7-c0da68a69f7b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:14.805438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2812-8f3e-4624-9db7-c0da68a69f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:14.891575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-532f2812-8f3e-4624-9db7-c0da68a69f7b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:14.892823 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-532f2812-8f3e-4624-9db7-c0da68a69f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:14.952484 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:15.015282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 723/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:15.056246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8f3ed-92cd-481e-bd8b-4922d5e60fab None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:15.057932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1ca8f3ed-92cd-481e-bd8b-4922d5e60fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:15.190261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8f3ed-92cd-481e-bd8b-4922d5e60fab None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:15.252257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:15.301569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd76bd-605a-4d7d-ae35-94b9c3694fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:15.302435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd76bd-605a-4d7d-ae35-94b9c3694fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:15.302767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd76bd-605a-4d7d-ae35-94b9c3694fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:15.303170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd76bd-605a-4d7d-ae35-94b9c3694fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:15.305191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-effd76bd-605a-4d7d-ae35-94b9c3694fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:15.443935 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd76bd-605a-4d7d-ae35-94b9c3694fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:15.445712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd76bd-605a-4d7d-ae35-94b9c3694fa5 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:15.469350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 747/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:25.013022 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=22 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:25.466774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=66 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:37.656662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6aa56-75aa-4a1d-9e0c-37983ae515ed None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:37.657281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6aa56-75aa-4a1d-9e0c-37983ae515ed None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:37.657281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6aa56-75aa-4a1d-9e0c-37983ae515ed None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:37.658641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 724/1471] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:19:37.666619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bd5a2-e414-4946-b32d-1aa72868b149 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:37.667213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bd5a2-e414-4946-b32d-1aa72868b149 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:37.667515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bd5a2-e414-4946-b32d-1aa72868b149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:37.794569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f58bd5a2-e414-4946-b32d-1aa72868b149 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:37.796954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f58bd5a2-e414-4946-b32d-1aa72868b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:37.930402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 748/1472] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:38.025491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4a37-57dd-423a-8209-90dc6145a835 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:38.025818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4a37-57dd-423a-8209-90dc6145a835 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:38.026205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4a37-57dd-423a-8209-90dc6145a835 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:38.027772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 725/1473] 10.222.0.46 () {54 vars in 966 bytes} [Thu Aug 4 05:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:19:38.033502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa33b-d8a9-4099-a27d-2fdf798be314 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:38.033901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa33b-d8a9-4099-a27d-2fdf798be314 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:38.034229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa33b-d8a9-4099-a27d-2fdf798be314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:38.125718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-920fa33b-d8a9-4099-a27d-2fdf798be314 None None] MFA Rules not processed for user `9fc9a884f16149cda246ea9638621296`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:38.127015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-920fa33b-d8a9-4099-a27d-2fdf798be314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:38.151500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:38.219922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 749/1474] 10.222.0.46 () {58 vars in 1063 bytes} [Thu Aug 4 05:19:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:38.233834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d4a37-57dd-423a-8209-90dc6145a835 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:38.235649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-dd7d4a37-57dd-423a-8209-90dc6145a835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:38.371900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d4a37-57dd-423a-8209-90dc6145a835 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:38.509791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00c256-e795-4c84-a9ae-4339f1d51b83 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc9a884f16149cda246ea9638621296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:38.510351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00c256-e795-4c84-a9ae-4339f1d51b83 service glance] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:38.510634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00c256-e795-4c84-a9ae-4339f1d51b83 service glance] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:38.510910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00c256-e795-4c84-a9ae-4339f1d51b83 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:38.512634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cd00c256-e795-4c84-a9ae-4339f1d51b83 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:38.577734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:38.664363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00c256-e795-4c84-a9ae-4339f1d51b83 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:38.667101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00c256-e795-4c84-a9ae-4339f1d51b83 service glance] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:38.706574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 726/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:40.979074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abae92-24ef-4f03-afdf-170b85ead53e None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:40.979706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abae92-24ef-4f03-afdf-170b85ead53e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:40.979706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abae92-24ef-4f03-afdf-170b85ead53e None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:40.981129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 750/1476] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:19:40.986447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97624946-a03f-4903-8f1b-d1f908cfea94 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:40.986952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97624946-a03f-4903-8f1b-d1f908cfea94 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:40.987091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97624946-a03f-4903-8f1b-d1f908cfea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:41.059484 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-97624946-a03f-4903-8f1b-d1f908cfea94 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:41.060734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-97624946-a03f-4903-8f1b-d1f908cfea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:41.184080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 727/1477] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:41.208187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abae92-24ef-4f03-afdf-170b85ead53e None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:41.209753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d4abae92-24ef-4f03-afdf-170b85ead53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:41.365077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abae92-24ef-4f03-afdf-170b85ead53e None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:41.423619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:41.480766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1375a0a-1d1f-41e5-8c44-e4f727abe6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:41.481864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375a0a-1d1f-41e5-8c44-e4f727abe6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:41.482405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375a0a-1d1f-41e5-8c44-e4f727abe6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:41.482712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375a0a-1d1f-41e5-8c44-e4f727abe6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:41.483641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1375a0a-1d1f-41e5-8c44-e4f727abe6e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:41.485556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WARNING py.warnings [None req-e1375a0a-1d1f-41e5-8c44-e4f727abe6e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:19:41.485556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: warnings.warn(msg) Aug 04 05:19:41.485556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: Aug 04 05:19:41.487510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1375a0a-1d1f-41e5-8c44-e4f727abe6e1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:41.511510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 751/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Aug 4 05:19:41 2022] GET /identity/v3/projects => generated 2553 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:43.721337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4397cb4-4b4d-4515-a0f6-000fe96c2098 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:43.722237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4397cb4-4b4d-4515-a0f6-000fe96c2098 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:43.722607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4397cb4-4b4d-4515-a0f6-000fe96c2098 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:43.724069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 728/1479] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:19:43.730228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfcc4b-1eb2-4a9c-afd0-9f44a8bbfc8a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:43.730859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfcc4b-1eb2-4a9c-afd0-9f44a8bbfc8a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:43.730859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfcc4b-1eb2-4a9c-afd0-9f44a8bbfc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:43.814175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-1bcfcc4b-1eb2-4a9c-afd0-9f44a8bbfc8a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:43.816340 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1bcfcc4b-1eb2-4a9c-afd0-9f44a8bbfc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:43.933201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 752/1480] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:43.979702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4397cb4-4b4d-4515-a0f6-000fe96c2098 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:43.981255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f4397cb4-4b4d-4515-a0f6-000fe96c2098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:43.993760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:44.163590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4397cb4-4b4d-4515-a0f6-000fe96c2098 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:44.259198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:44.298913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaab7d8-ce63-410f-a392-5c2dc80400b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:44.300212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaab7d8-ce63-410f-a392-5c2dc80400b7 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:44.300602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaab7d8-ce63-410f-a392-5c2dc80400b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:44.300951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaab7d8-ce63-410f-a392-5c2dc80400b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:44.303443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8eaab7d8-ce63-410f-a392-5c2dc80400b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:44.443471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaab7d8-ce63-410f-a392-5c2dc80400b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:44.446464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaab7d8-ce63-410f-a392-5c2dc80400b7 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:44.481826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 729/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:47.006671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69b3c7-3487-4971-a9ab-bad33470f7a9 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:47.007258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69b3c7-3487-4971-a9ab-bad33470f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:47.007258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69b3c7-3487-4971-a9ab-bad33470f7a9 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:47.008593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 753/1482] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:19:47.014784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474344b-0da2-4482-a27b-457896903274 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:47.015317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474344b-0da2-4482-a27b-457896903274 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:47.015434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474344b-0da2-4482-a27b-457896903274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:47.095852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-1474344b-0da2-4482-a27b-457896903274 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:47.097186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1474344b-0da2-4482-a27b-457896903274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:47.152784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:47.212629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 730/1483] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:47.252078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69b3c7-3487-4971-a9ab-bad33470f7a9 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:47.253948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5f69b3c7-3487-4971-a9ab-bad33470f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:47.283021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:47.380052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69b3c7-3487-4971-a9ab-bad33470f7a9 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:47.471186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde4b9c-5a17-49ec-8f94-63adaeaf1c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:47.472015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4b9c-5a17-49ec-8f94-63adaeaf1c89 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:47.472334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4b9c-5a17-49ec-8f94-63adaeaf1c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:47.472764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4b9c-5a17-49ec-8f94-63adaeaf1c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:47.474785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-acde4b9c-5a17-49ec-8f94-63adaeaf1c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:47.575239 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:47.618164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde4b9c-5a17-49ec-8f94-63adaeaf1c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:47.619667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde4b9c-5a17-49ec-8f94-63adaeaf1c89 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:47.641114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 754/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:49.848523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a074d4-30a7-4a0e-ad44-a3555851b079 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:49.849467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a074d4-30a7-4a0e-ad44-a3555851b079 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:49.849467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a074d4-30a7-4a0e-ad44-a3555851b079 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:49.851334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 731/1485] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:19:49.858055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9424-c879-43f0-b353-10b1652732b6 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:49.858723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9424-c879-43f0-b353-10b1652732b6 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:49.858723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9424-c879-43f0-b353-10b1652732b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:49.944912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-480e9424-c879-43f0-b353-10b1652732b6 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:49.946281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-480e9424-c879-43f0-b353-10b1652732b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:50.064541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 755/1486] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:50.106474 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a074d4-30a7-4a0e-ad44-a3555851b079 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:50.108612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e1a074d4-30a7-4a0e-ad44-a3555851b079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:50.275145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a074d4-30a7-4a0e-ad44-a3555851b079 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:50.416220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:50.419445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d2771-c31c-443c-9d18-04110701657b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:50.420520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d2771-c31c-443c-9d18-04110701657b service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:50.421003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d2771-c31c-443c-9d18-04110701657b service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:50.421470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d2771-c31c-443c-9d18-04110701657b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:50.425567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d64d2771-c31c-443c-9d18-04110701657b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:50.579235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d2771-c31c-443c-9d18-04110701657b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:50.581673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d2771-c31c-443c-9d18-04110701657b service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:50.604059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 732/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:52.872003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1b5e0-f8e1-4062-9cac-75dfbf046ab4 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:52.872565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1b5e0-f8e1-4062-9cac-75dfbf046ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:52.872565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1b5e0-f8e1-4062-9cac-75dfbf046ab4 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:52.874105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 756/1488] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:19:52.881608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73860c69-37cd-4929-bd07-665ebe0014e8 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:52.911468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73860c69-37cd-4929-bd07-665ebe0014e8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:52.911468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73860c69-37cd-4929-bd07-665ebe0014e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:52.970521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-73860c69-37cd-4929-bd07-665ebe0014e8 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:52.972856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-73860c69-37cd-4929-bd07-665ebe0014e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:53.040403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:53.092480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 733/1489] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:53.137147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1b5e0-f8e1-4062-9cac-75dfbf046ab4 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:53.138733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7de1b5e0-f8e1-4062-9cac-75dfbf046ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:53.181664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:53.260273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1b5e0-f8e1-4062-9cac-75dfbf046ab4 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:53.342724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8489c32-89c7-47ab-8b73-a899f318e3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:53.343348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489c32-89c7-47ab-8b73-a899f318e3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:53.343630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489c32-89c7-47ab-8b73-a899f318e3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:53.343899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8489c32-89c7-47ab-8b73-a899f318e3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:53.345573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d8489c32-89c7-47ab-8b73-a899f318e3a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:53.447402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:53.483172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8489c32-89c7-47ab-8b73-a899f318e3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:53.484753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8489c32-89c7-47ab-8b73-a899f318e3a2 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:53.508514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 757/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:56.062327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae2f8-4486-4114-a38a-f2c07d3523f8 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:56.062927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae2f8-4486-4114-a38a-f2c07d3523f8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:56.062927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae2f8-4486-4114-a38a-f2c07d3523f8 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:56.064244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 734/1491] 10.222.0.46 () {54 vars in 927 bytes} [Thu Aug 4 05:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:19:56.070599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c670-a923-4d59-ba38-dd4d64de8bc9 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:56.071120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c670-a923-4d59-ba38-dd4d64de8bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:56.071605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c670-a923-4d59-ba38-dd4d64de8bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:56.150659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-88e5c670-a923-4d59-ba38-dd4d64de8bc9 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:56.151904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-88e5c670-a923-4d59-ba38-dd4d64de8bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:56.276197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 758/1492] 10.222.0.46 () {58 vars in 1024 bytes} [Thu Aug 4 05:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:56.318744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae2f8-4486-4114-a38a-f2c07d3523f8 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:56.320208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cc0ae2f8-4486-4114-a38a-f2c07d3523f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:56.444611 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae2f8-4486-4114-a38a-f2c07d3523f8 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:56.538617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3864e9-05a9-415d-a674-4e232bb7a3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:56.539388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3864e9-05a9-415d-a674-4e232bb7a3eb service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:56.539817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3864e9-05a9-415d-a674-4e232bb7a3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:56.540284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3864e9-05a9-415d-a674-4e232bb7a3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:56.542453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9b3864e9-05a9-415d-a674-4e232bb7a3eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:56.556731 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:56.696153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3864e9-05a9-415d-a674-4e232bb7a3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:56.697943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3864e9-05a9-415d-a674-4e232bb7a3eb service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:56.726011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 735/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:20:06.274345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=82 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:06.722940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=50 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:25.200818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37418954-b5e5-4d4a-a42b-46cd260bf4fd None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:25.201426 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37418954-b5e5-4d4a-a42b-46cd260bf4fd None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:25.201426 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37418954-b5e5-4d4a-a42b-46cd260bf4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:25.325393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-37418954-b5e5-4d4a-a42b-46cd260bf4fd None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:25.326712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-37418954-b5e5-4d4a-a42b-46cd260bf4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:25.450050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 759/1494] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:21:25.459881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c386849-4202-4c9c-9920-a470604dd97e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:25.460520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c386849-4202-4c9c-9920-a470604dd97e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:25.460904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c386849-4202-4c9c-9920-a470604dd97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:25.573575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-2c386849-4202-4c9c-9920-a470604dd97e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:25.574975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2c386849-4202-4c9c-9920-a470604dd97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:25.697672 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 736/1495] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:25.706182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37418954-b5e5-4d4a-a42b-46cd260bf4fd None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:25.708554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-37418954-b5e5-4d4a-a42b-46cd260bf4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:25.730231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37418954-b5e5-4d4a-a42b-46cd260bf4fd None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:25.816493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:25.859961 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:25.860594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:25.860866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:25.861133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:25.862509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:21:25.862819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:25.863870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WARNING py.warnings [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:21:25.863870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: warnings.warn(msg) Aug 04 05:21:25.863870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: Aug 04 05:21:25.864801 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:25.878863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 760/1496] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:21:25.889975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c386849-4202-4c9c-9920-a470604dd97e None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:25.900907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c386849-4202-4c9c-9920-a470604dd97e None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:25.973842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:26.012180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b8ec4-8dd7-45fd-bf4b-b16afefd2136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:26.012803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b8ec4-8dd7-45fd-bf4b-b16afefd2136 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:26.013076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b8ec4-8dd7-45fd-bf4b-b16afefd2136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:26.013345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b8ec4-8dd7-45fd-bf4b-b16afefd2136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:26.014006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b8ec4-8dd7-45fd-bf4b-b16afefd2136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:26.015799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: WARNING py.warnings [None req-242b8ec4-8dd7-45fd-bf4b-b16afefd2136 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:21:26.015799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: warnings.warn(msg) Aug 04 05:21:26.015799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: Aug 04 05:21:26.016999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b8ec4-8dd7-45fd-bf4b-b16afefd2136 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:26.322553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 737/1497] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:21:25 2022] POST /identity/v3/projects => generated 379 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:21:26.326855 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:26.328377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:26.362939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce465f-6ddc-4a53-9106-adfcb45bf2f7 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:26.463676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af64ba1-a217-4a7f-b6c5-3b4967346ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:26.464317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af64ba1-a217-4a7f-b6c5-3b4967346ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:26.464595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af64ba1-a217-4a7f-b6c5-3b4967346ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:26.465034 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af64ba1-a217-4a7f-b6c5-3b4967346ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:26.465760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af64ba1-a217-4a7f-b6c5-3b4967346ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:26.466822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WARNING py.warnings [None req-8af64ba1-a217-4a7f-b6c5-3b4967346ac9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:21:26.466822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: warnings.warn(msg) Aug 04 05:21:26.466822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: Aug 04 05:21:26.468111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af64ba1-a217-4a7f-b6c5-3b4967346ac9 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:26.656671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 761/1498] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:21:26 2022] POST /identity/v3/users => generated 290 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:21:26.662271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b8ec4-8dd7-45fd-bf4b-b16afefd2136 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:26.667309 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-242b8ec4-8dd7-45fd-bf4b-b16afefd2136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:26.761440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b8ec4-8dd7-45fd-bf4b-b16afefd2136 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:26.870099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:26.889186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3b170-eb49-4422-8ee1-553309c962c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:26.889859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3b170-eb49-4422-8ee1-553309c962c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:26.890330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3b170-eb49-4422-8ee1-553309c962c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:26.890854 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3b170-eb49-4422-8ee1-553309c962c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:26.891927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3b170-eb49-4422-8ee1-553309c962c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:26.893944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: WARNING py.warnings [None req-15a3b170-eb49-4422-8ee1-553309c962c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:21:26.893944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: warnings.warn(msg) Aug 04 05:21:26.893944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: Aug 04 05:21:26.895480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3b170-eb49-4422-8ee1-553309c962c3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:26.919047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 738/1499] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:21:26.924835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af64ba1-a217-4a7f-b6c5-3b4967346ac9 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:26.927758 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8af64ba1-a217-4a7f-b6c5-3b4967346ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:26.946931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af64ba1-a217-4a7f-b6c5-3b4967346ac9 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:26.993460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:27.082685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da58464-89cf-4d36-a192-67b6fdcb4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:27.083436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da58464-89cf-4d36-a192-67b6fdcb4227 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:27.083436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da58464-89cf-4d36-a192-67b6fdcb4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:27.083868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da58464-89cf-4d36-a192-67b6fdcb4227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:27.084578 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da58464-89cf-4d36-a192-67b6fdcb4227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:27.085598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WARNING py.warnings [None req-1da58464-89cf-4d36-a192-67b6fdcb4227 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:21:27.085598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: warnings.warn(msg) Aug 04 05:21:27.085598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: Aug 04 05:21:27.086514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da58464-89cf-4d36-a192-67b6fdcb4227 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:27.101743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 762/1500] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:21:27.107934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3b170-eb49-4422-8ee1-553309c962c3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:27.111155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-15a3b170-eb49-4422-8ee1-553309c962c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:27.175889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3b170-eb49-4422-8ee1-553309c962c3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:27.292692 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b62fa5-d81d-4313-83b5-469a54ce3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:27.293680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b62fa5-d81d-4313-83b5-469a54ce3a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:27.293966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b62fa5-d81d-4313-83b5-469a54ce3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:27.294243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b62fa5-d81d-4313-83b5-469a54ce3a9e admin admin] PATH_INFO: `/v3/projects/a41b0d19ed5d4caa98b3dd658c5b8e48/users/c28e7a7b1ecc46ac8876a888c04cb4e4/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:27.320375 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b62fa5-d81d-4313-83b5-469a54ce3a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41b0d19ed5d4caa98b3dd658c5b8e48, user_id=c28e7a7b1ecc46ac8876a888c04cb4e4, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:27.321430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: WARNING py.warnings [None req-78b62fa5-d81d-4313-83b5-469a54ce3a9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:21:27.321430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: warnings.warn(msg) Aug 04 05:21:27.321430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: Aug 04 05:21:27.323422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b62fa5-d81d-4313-83b5-469a54ce3a9e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:27.403805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 739/1501] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:21:27 2022] PUT /identity/v3/projects/a41b0d19ed5d4caa98b3dd658c5b8e48/users/c28e7a7b1ecc46ac8876a888c04cb4e4/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:21:27.417596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a201ed-4f4b-4592-a812-f7cb775863e9 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:27.418198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a201ed-4f4b-4592-a812-f7cb775863e9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:27.418198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a201ed-4f4b-4592-a812-f7cb775863e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:27.480451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-86a201ed-4f4b-4592-a812-f7cb775863e9 None None] MFA Rules not processed for user `c28e7a7b1ecc46ac8876a888c04cb4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:27.481588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-86a201ed-4f4b-4592-a812-f7cb775863e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:27.590227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 763/1502] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:21:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:21:27.605505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5faf93-9c80-4536-b51e-b3b61a619be0 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:27.605917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5faf93-9c80-4536-b51e-b3b61a619be0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:27.606088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5faf93-9c80-4536-b51e-b3b61a619be0 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:27.607692 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 740/1503] 10.222.0.46 () {54 vars in 964 bytes} [Thu Aug 4 05:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:21:27.614814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd672-2fee-46d6-b1d7-33dffd23e34d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:27.615361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd672-2fee-46d6-b1d7-33dffd23e34d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:27.615633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd672-2fee-46d6-b1d7-33dffd23e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:27.676702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:27.739741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-2a8bd672-2fee-46d6-b1d7-33dffd23e34d None None] MFA Rules not processed for user `600993aa29bc452f8658ed8cb426b470`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:27.740967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2a8bd672-2fee-46d6-b1d7-33dffd23e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:27.839119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 764/1504] 10.222.0.46 () {58 vars in 1061 bytes} [Thu Aug 4 05:21:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:27.849633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5faf93-9c80-4536-b51e-b3b61a619be0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:27.852206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7d5faf93-9c80-4536-b51e-b3b61a619be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:27.916374 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:28.001893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5faf93-9c80-4536-b51e-b3b61a619be0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:28.095078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddb09c-d348-43b8-a05f-503500dc1d77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:28.095724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb09c-d348-43b8-a05f-503500dc1d77 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:28.096007 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb09c-d348-43b8-a05f-503500dc1d77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:28.096277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb09c-d348-43b8-a05f-503500dc1d77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:28.097979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7dddb09c-d348-43b8-a05f-503500dc1d77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:28.239902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddb09c-d348-43b8-a05f-503500dc1d77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:28.241455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddb09c-d348-43b8-a05f-503500dc1d77 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:28.245836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:28.265184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 741/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:28.332493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d8e5e-922b-4578-af73-797c20e60696 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:28.332890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d8e5e-922b-4578-af73-797c20e60696 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:28.333165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d8e5e-922b-4578-af73-797c20e60696 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:28.334605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 765/1506] 10.222.0.46 () {52 vars in 830 bytes} [Thu Aug 4 05:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:21:28.339263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddb09c-d348-43b8-a05f-503500dc1d77 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:28.340889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7dddb09c-d348-43b8-a05f-503500dc1d77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:28.474124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddb09c-d348-43b8-a05f-503500dc1d77 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:28.602561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:28.603561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:28.604105 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:28.604875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] PATH_INFO: `/v3/users/c28e7a7b1ecc46ac8876a888c04cb4e4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:28.623554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28e7a7b1ecc46ac8876a888c04cb4e4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:28.624596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: WARNING py.warnings [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:21:28.624596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: warnings.warn(msg) Aug 04 05:21:28.624596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: Aug 04 05:21:28.625817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:28.637874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:28.862802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28e7a7b1ecc46ac8876a888c04cb4e4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:21:28.863470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28e7a7b1ecc46ac8876a888c04cb4e4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:21:28.879218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28e7a7b1ecc46ac8876a888c04cb4e4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:21:28.879755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28e7a7b1ecc46ac8876a888c04cb4e4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:21:28.940371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28e7a7b1ecc46ac8876a888c04cb4e4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:21:28.988348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 742/1507] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:21:28 2022] DELETE /identity/v3/users/c28e7a7b1ecc46ac8876a888c04cb4e4 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:21:28.994116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864abf1-fff4-4fc5-8d25-7250bb6c2199 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:28.994773 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864abf1-fff4-4fc5-8d25-7250bb6c2199 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:28.994773 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864abf1-fff4-4fc5-8d25-7250bb6c2199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:29.069094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0864abf1-fff4-4fc5-8d25-7250bb6c2199 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:29.070434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0864abf1-fff4-4fc5-8d25-7250bb6c2199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:29.160231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:29.179430 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 766/1508] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:21:29.189668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:29.191163 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:29.308944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c877db7-aa9c-45f3-93ab-091822f8f3ba admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:29.374901 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:29.395781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee29a7-7a75-4e01-9151-47fa880f7f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:29.396442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee29a7-7a75-4e01-9151-47fa880f7f36 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:29.396722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee29a7-7a75-4e01-9151-47fa880f7f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:29.396992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee29a7-7a75-4e01-9151-47fa880f7f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:29.398666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2bee29a7-7a75-4e01-9151-47fa880f7f36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:29.537969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee29a7-7a75-4e01-9151-47fa880f7f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:29.540120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee29a7-7a75-4e01-9151-47fa880f7f36 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:29.579771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 743/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:30.291941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864abf1-fff4-4fc5-8d25-7250bb6c2199 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:30.293242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0864abf1-fff4-4fc5-8d25-7250bb6c2199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:30.309451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864abf1-fff4-4fc5-8d25-7250bb6c2199 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:30.463946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:30.464490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:30.464760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:30.465022 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] PATH_INFO: `/v3/projects/a41b0d19ed5d4caa98b3dd658c5b8e48` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:30.476901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41b0d19ed5d4caa98b3dd658c5b8e48)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:30.477936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WARNING py.warnings [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:21:30.477936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: warnings.warn(msg) Aug 04 05:21:30.477936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: Aug 04 05:21:30.479175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:30.633904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41b0d19ed5d4caa98b3dd658c5b8e48', 'request_id': 'req-194f51e3-a724-4841-93a6-8b469c59ca08'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:21:30.660044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41b0d19ed5d4caa98b3dd658c5b8e48', 'request_id': 'req-194f51e3-a724-4841-93a6-8b469c59ca08'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:21:30.757849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41b0d19ed5d4caa98b3dd658c5b8e48', 'request_id': 'req-194f51e3-a724-4841-93a6-8b469c59ca08'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:21:30.785543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] The token cache is being invalidate because project a41b0d19ed5d4caa98b3dd658c5b8e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:21:30.785874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:21:30.787705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-194f51e3-a724-4841-93a6-8b469c59ca08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:21:30.789133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 767/1510] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:21:30 2022] DELETE /identity/v3/projects/a41b0d19ed5d4caa98b3dd658c5b8e48 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:21:39.587483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=62 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:40.783271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:03.066369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6070f8-90d5-444b-90b2-f6bda4980a2e None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:03.067465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6070f8-90d5-444b-90b2-f6bda4980a2e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:03.067465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6070f8-90d5-444b-90b2-f6bda4980a2e None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:03.069245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 744/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:23:03.074608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92185c-e86c-4aba-b400-2018a486c550 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:03.075142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92185c-e86c-4aba-b400-2018a486c550 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:03.075142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92185c-e86c-4aba-b400-2018a486c550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:03.175511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ba92185c-e86c-4aba-b400-2018a486c550 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:03.177370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ba92185c-e86c-4aba-b400-2018a486c550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:03.284682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 768/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:03.439847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6070f8-90d5-444b-90b2-f6bda4980a2e None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:03.443973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8b6070f8-90d5-444b-90b2-f6bda4980a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:03.610795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6070f8-90d5-444b-90b2-f6bda4980a2e None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:03.620839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5208898-4951-4a0e-965c-41b6e2c7cb1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:03.621924 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208898-4951-4a0e-965c-41b6e2c7cb1c service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:03.622478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208898-4951-4a0e-965c-41b6e2c7cb1c service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:03.622995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208898-4951-4a0e-965c-41b6e2c7cb1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:03.638393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5208898-4951-4a0e-965c-41b6e2c7cb1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:03.641494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5208898-4951-4a0e-965c-41b6e2c7cb1c service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:03.659516 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 745/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:04.522045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577049d-75fc-4cc9-83f9-81a8350c578d None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:04.522658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577049d-75fc-4cc9-83f9-81a8350c578d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:04.522658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577049d-75fc-4cc9-83f9-81a8350c578d None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:04.523968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 769/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:23:04.529212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902deea-de12-4931-8d57-be90468a2685 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:04.529701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902deea-de12-4931-8d57-be90468a2685 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:04.529836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902deea-de12-4931-8d57-be90468a2685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:04.552764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-6902deea-de12-4931-8d57-be90468a2685 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:04.554495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6902deea-de12-4931-8d57-be90468a2685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:04.563556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 746/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:04.615491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46548e7d-7c97-4dc0-bc9e-0d4c03bd78fc None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:04.615804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46548e7d-7c97-4dc0-bc9e-0d4c03bd78fc None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:04.616078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46548e7d-7c97-4dc0-bc9e-0d4c03bd78fc None None] PATH_INFO: `/v3` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:04.617369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 770/1516] 10.222.0.66 () {54 vars in 925 bytes} [Thu Aug 4 05:23:04 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:23:04.624480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928d30-b98c-4048-9b2e-d325b2d44c57 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:04.624756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928d30-b98c-4048-9b2e-d325b2d44c57 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:04.625051 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928d30-b98c-4048-9b2e-d325b2d44c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:04.700541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c3928d30-b98c-4048-9b2e-d325b2d44c57 None None] MFA Rules not processed for user `448d43be14a74865a1e0d09e76c7e248`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:04.701794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c3928d30-b98c-4048-9b2e-d325b2d44c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:04.729041 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46548e7d-7c97-4dc0-bc9e-0d4c03bd78fc None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:04.745788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46548e7d-7c97-4dc0-bc9e-0d4c03bd78fc None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:04.751766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d274f-bf63-4a08-acde-1abefc4258bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:04.752923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d274f-bf63-4a08-acde-1abefc4258bc service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:04.753195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d274f-bf63-4a08-acde-1abefc4258bc service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:04.753534 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d274f-bf63-4a08-acde-1abefc4258bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:04.764028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d274f-bf63-4a08-acde-1abefc4258bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:04.765666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d274f-bf63-4a08-acde-1abefc4258bc service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:04.770277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:04.776565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 771/1517] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:23:04.794472 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 747/1518] 10.222.0.66 () {58 vars in 1015 bytes} [Thu Aug 4 05:23:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:14.067140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b887-4df2-4c2c-bd8e-b6b803ddb006 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:14.068403 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b887-4df2-4c2c-bd8e-b6b803ddb006 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:14.068403 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b887-4df2-4c2c-bd8e-b6b803ddb006 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:14.070682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 772/1519] 10.222.0.46 () {54 vars in 961 bytes} [Thu Aug 4 05:23:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:23:14.076244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63b0f-d576-4abf-8bdc-4e6fcc600a77 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:14.076798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63b0f-d576-4abf-8bdc-4e6fcc600a77 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:14.076798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63b0f-d576-4abf-8bdc-4e6fcc600a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:14.098890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-88e63b0f-d576-4abf-8bdc-4e6fcc600a77 None None] MFA Rules not processed for user `448d43be14a74865a1e0d09e76c7e248`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:14.100695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-88e63b0f-d576-4abf-8bdc-4e6fcc600a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:14.109505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 748/1520] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Aug 4 05:23:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:14.119072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139b887-4df2-4c2c-bd8e-b6b803ddb006 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:14.134604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139b887-4df2-4c2c-bd8e-b6b803ddb006 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:14.139782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7182bab-d424-42f2-974e-0606360780c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:14.140411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182bab-d424-42f2-974e-0606360780c8 service placement] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:14.140691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182bab-d424-42f2-974e-0606360780c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:14.140964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182bab-d424-42f2-974e-0606360780c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:14.150779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7182bab-d424-42f2-974e-0606360780c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:14.152382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7182bab-d424-42f2-974e-0606360780c8 service placement] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:14.164386 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 773/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:16.074141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4b668-50e8-4c8b-82ee-0ffa8c525546 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:16.074910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4b668-50e8-4c8b-82ee-0ffa8c525546 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:16.074910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4b668-50e8-4c8b-82ee-0ffa8c525546 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:16.076303 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:23:16.082142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383bed-5e4d-4f0d-a267-34f80494c3b9 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:16.082778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383bed-5e4d-4f0d-a267-34f80494c3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:16.082778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383bed-5e4d-4f0d-a267-34f80494c3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:16.106208 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f1383bed-5e4d-4f0d-a267-34f80494c3b9 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:16.107508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f1383bed-5e4d-4f0d-a267-34f80494c3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:16.117089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:23:16.278021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4b668-50e8-4c8b-82ee-0ffa8c525546 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:16.295638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4b668-50e8-4c8b-82ee-0ffa8c525546 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:16.302561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73528efc-a986-4350-8576-b30036f5e9d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:16.303549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73528efc-a986-4350-8576-b30036f5e9d8 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:16.303979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73528efc-a986-4350-8576-b30036f5e9d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:16.304368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73528efc-a986-4350-8576-b30036f5e9d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:16.314555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73528efc-a986-4350-8576-b30036f5e9d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:16.316215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73528efc-a986-4350-8576-b30036f5e9d8 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:16.327985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 750/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:17.271576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234769-4afb-4327-8d71-089f8e7a1828 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:17.272287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234769-4afb-4327-8d71-089f8e7a1828 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:17.272287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234769-4afb-4327-8d71-089f8e7a1828 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:17.273518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:23:17.281565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2590d00-e2ca-48d3-9eb9-832d60c06e74 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:17.282160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2590d00-e2ca-48d3-9eb9-832d60c06e74 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:17.282289 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2590d00-e2ca-48d3-9eb9-832d60c06e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:17.304329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d2590d00-e2ca-48d3-9eb9-832d60c06e74 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:17.305586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d2590d00-e2ca-48d3-9eb9-832d60c06e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:17.314694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:17.469638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234769-4afb-4327-8d71-089f8e7a1828 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:17.486140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234769-4afb-4327-8d71-089f8e7a1828 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:17.492746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583c73b-8fe8-4dbf-8d2c-c40b08a2bb4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:17.493370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583c73b-8fe8-4dbf-8d2c-c40b08a2bb4e service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:17.493650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583c73b-8fe8-4dbf-8d2c-c40b08a2bb4e service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:17.493928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583c73b-8fe8-4dbf-8d2c-c40b08a2bb4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:17.503405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583c73b-8fe8-4dbf-8d2c-c40b08a2bb4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:17.505192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583c73b-8fe8-4dbf-8d2c-c40b08a2bb4e service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:17.516050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 776/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:21.428443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c1d17-b363-4363-9aa9-0e91d3ef53da None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:21.429302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c1d17-b363-4363-9aa9-0e91d3ef53da None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:21.429302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c1d17-b363-4363-9aa9-0e91d3ef53da None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:21.430237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:23:21.436822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f42e07-e9d5-4a5d-a1ce-aeb8d47953b5 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:21.437409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f42e07-e9d5-4a5d-a1ce-aeb8d47953b5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:21.437507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f42e07-e9d5-4a5d-a1ce-aeb8d47953b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:21.469156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-62f42e07-e9d5-4a5d-a1ce-aeb8d47953b5 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:21.471279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-62f42e07-e9d5-4a5d-a1ce-aeb8d47953b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:21.483145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:21.563825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c1d17-b363-4363-9aa9-0e91d3ef53da None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:21.565533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9b5c1d17-b363-4363-9aa9-0e91d3ef53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:21.650744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c1d17-b363-4363-9aa9-0e91d3ef53da None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:21.654446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6846d-d9ac-417e-949c-ca5d50594109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:21.655068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6846d-d9ac-417e-949c-ca5d50594109 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:21.655345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6846d-d9ac-417e-949c-ca5d50594109 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:21.655615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6846d-d9ac-417e-949c-ca5d50594109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:21.666201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6846d-d9ac-417e-949c-ca5d50594109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:21.667665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6846d-d9ac-417e-949c-ca5d50594109 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:21.677800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 753/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:23.759053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f074040-5e01-4c68-a37f-ea4f1fd3173b None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:23.759823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f074040-5e01-4c68-a37f-ea4f1fd3173b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:23.759823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f074040-5e01-4c68-a37f-ea4f1fd3173b None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:23.760976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:23:23.771159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308029d-b8b3-4d77-bc07-429c5439de0b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:23.771792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308029d-b8b3-4d77-bc07-429c5439de0b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:23.772123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308029d-b8b3-4d77-bc07-429c5439de0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:23.805509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-a308029d-b8b3-4d77-bc07-429c5439de0b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:23.807668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a308029d-b8b3-4d77-bc07-429c5439de0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:23.822361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:23.859847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f074040-5e01-4c68-a37f-ea4f1fd3173b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:23.872181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f074040-5e01-4c68-a37f-ea4f1fd3173b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:23.877413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9a92a-aeab-492b-ba6d-4f3457d4cc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:23.878451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9a92a-aeab-492b-ba6d-4f3457d4cc51 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:23.878956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9a92a-aeab-492b-ba6d-4f3457d4cc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:23.879443 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9a92a-aeab-492b-ba6d-4f3457d4cc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:23.896644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9a92a-aeab-492b-ba6d-4f3457d4cc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:23.898123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9a92a-aeab-492b-ba6d-4f3457d4cc51 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:23.909579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 779/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:23:27.675938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82e9d-1223-4476-a1f3-56bae49e5aba None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:27.676566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82e9d-1223-4476-a1f3-56bae49e5aba None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:27.676690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82e9d-1223-4476-a1f3-56bae49e5aba None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:27.678219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:23:27.683842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012080-bd1f-4055-870e-51948086437b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:27.684452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012080-bd1f-4055-870e-51948086437b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:27.684452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012080-bd1f-4055-870e-51948086437b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:27.692128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:27.704690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b7012080-bd1f-4055-870e-51948086437b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:27.709786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b7012080-bd1f-4055-870e-51948086437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:27.715069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:28.034017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82e9d-1223-4476-a1f3-56bae49e5aba None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:28.037019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-45a82e9d-1223-4476-a1f3-56bae49e5aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:28.129567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82e9d-1223-4476-a1f3-56bae49e5aba None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:28.133906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f47f94-6dc1-4057-be31-7ae651922bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:28.134649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f47f94-6dc1-4057-be31-7ae651922bff service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:28.134929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f47f94-6dc1-4057-be31-7ae651922bff service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:28.135229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f47f94-6dc1-4057-be31-7ae651922bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:28.145306 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f47f94-6dc1-4057-be31-7ae651922bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:28.146787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f47f94-6dc1-4057-be31-7ae651922bff service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:28.157100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 756/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:30.248981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589010b-8b1a-44c0-94aa-2dfc1d45d648 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:30.249542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589010b-8b1a-44c0-94aa-2dfc1d45d648 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:30.249649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589010b-8b1a-44c0-94aa-2dfc1d45d648 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:30.251074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:23:30.257055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829217ed-ad5e-4feb-b05e-c55b426d081a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:30.257498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829217ed-ad5e-4feb-b05e-c55b426d081a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:30.257615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829217ed-ad5e-4feb-b05e-c55b426d081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:30.277632 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-829217ed-ad5e-4feb-b05e-c55b426d081a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:30.278879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-829217ed-ad5e-4feb-b05e-c55b426d081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:30.287086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:30.611894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589010b-8b1a-44c0-94aa-2dfc1d45d648 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:30.613718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8589010b-8b1a-44c0-94aa-2dfc1d45d648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:30.627784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589010b-8b1a-44c0-94aa-2dfc1d45d648 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:30.632263 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634745b-d49a-403e-af74-f6e2385bbd61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:30.632872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634745b-d49a-403e-af74-f6e2385bbd61 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:30.633150 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634745b-d49a-403e-af74-f6e2385bbd61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:30.633422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634745b-d49a-403e-af74-f6e2385bbd61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:30.642731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634745b-d49a-403e-af74-f6e2385bbd61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:30.644448 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634745b-d49a-403e-af74-f6e2385bbd61 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:30.654030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 782/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:40.272375 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=92 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:40.649841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=8 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:55.385165 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f9d1-4188-40af-a145-f0fb9d26554d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:55.386769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f9d1-4188-40af-a145-f0fb9d26554d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:55.386769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f9d1-4188-40af-a145-f0fb9d26554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:55.411732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9382f9d1-4188-40af-a145-f0fb9d26554d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:55.413344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9382f9d1-4188-40af-a145-f0fb9d26554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:55.422149 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 758/1540] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:55.431396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505734f-702e-47ae-8ebe-701c0c60c53e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:55.432728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505734f-702e-47ae-8ebe-701c0c60c53e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:55.434068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505734f-702e-47ae-8ebe-701c0c60c53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:55.468224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b505734f-702e-47ae-8ebe-701c0c60c53e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:55.469830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b505734f-702e-47ae-8ebe-701c0c60c53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:55.482596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 783/1541] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:55.487960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382f9d1-4188-40af-a145-f0fb9d26554d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:55.490390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f53fe-ee17-48ef-b3c9-2f21597bf4b0 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:55.490927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f53fe-ee17-48ef-b3c9-2f21597bf4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:55.491435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f53fe-ee17-48ef-b3c9-2f21597bf4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:55.503650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382f9d1-4188-40af-a145-f0fb9d26554d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:55.509121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7aa949-50af-43aa-add1-6883de411605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:55.509747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aa949-50af-43aa-add1-6883de411605 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:55.510029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aa949-50af-43aa-add1-6883de411605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:55.510319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aa949-50af-43aa-add1-6883de411605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:55.511088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7aa949-50af-43aa-add1-6883de411605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:55.511908 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7aa949-50af-43aa-add1-6883de411605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:55.512942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: WARNING py.warnings [None req-9c7aa949-50af-43aa-add1-6883de411605 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:24:55.512942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: warnings.warn(msg) Aug 04 05:24:55.512942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: Aug 04 05:24:55.513827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7aa949-50af-43aa-add1-6883de411605 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:55.532151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ab7f53fe-ee17-48ef-b3c9-2f21597bf4b0 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:55.534535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ab7f53fe-ee17-48ef-b3c9-2f21597bf4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:55.551085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 759/1542] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:55.553091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 784/1543] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:24:55.563080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7aa949-50af-43aa-add1-6883de411605 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:55.563642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc65da4-be54-4f97-81fb-274d6e95f5f3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:55.564167 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc65da4-be54-4f97-81fb-274d6e95f5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:55.564669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc65da4-be54-4f97-81fb-274d6e95f5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:55.581939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7aa949-50af-43aa-add1-6883de411605 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:55.590335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a98109-460d-40f2-b0a9-b3bbfdba7085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:55.590335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a98109-460d-40f2-b0a9-b3bbfdba7085 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:55.590335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a98109-460d-40f2-b0a9-b3bbfdba7085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:55.590335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a98109-460d-40f2-b0a9-b3bbfdba7085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:55.590791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a98109-460d-40f2-b0a9-b3bbfdba7085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:55.598469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a98109-460d-40f2-b0a9-b3bbfdba7085 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:55.607533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-1bc65da4-be54-4f97-81fb-274d6e95f5f3 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:55.609140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1bc65da4-be54-4f97-81fb-274d6e95f5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:55.628691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 785/1544] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:55.633790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc65da4-be54-4f97-81fb-274d6e95f5f3 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:55.648613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc65da4-be54-4f97-81fb-274d6e95f5f3 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:55.659915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691951b-191b-4be1-9aed-e3022252fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:55.670474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691951b-191b-4be1-9aed-e3022252fe32 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:55.670474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691951b-191b-4be1-9aed-e3022252fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:55.670474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691951b-191b-4be1-9aed-e3022252fe32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:55.670474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691951b-191b-4be1-9aed-e3022252fe32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:55.670474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691951b-191b-4be1-9aed-e3022252fe32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:55.670474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691951b-191b-4be1-9aed-e3022252fe32 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:55.686468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 786/1545] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:55.696893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691951b-191b-4be1-9aed-e3022252fe32 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:55.712603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691951b-191b-4be1-9aed-e3022252fe32 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:55.718368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853989-69f7-4cf3-b9fb-13a4ce0a1e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:55.719466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853989-69f7-4cf3-b9fb-13a4ce0a1e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:55.720143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853989-69f7-4cf3-b9fb-13a4ce0a1e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:55.720648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853989-69f7-4cf3-b9fb-13a4ce0a1e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:55.721564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2853989-69f7-4cf3-b9fb-13a4ce0a1e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:55.722914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WARNING py.warnings [None req-f2853989-69f7-4cf3-b9fb-13a4ce0a1e8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:24:55.722914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: warnings.warn(msg) Aug 04 05:24:55.722914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: Aug 04 05:24:55.727418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2853989-69f7-4cf3-b9fb-13a4ce0a1e8e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:55.754779 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 760/1546] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:55 2022] POST /identity/v3/projects => generated 405 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:55.759360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a98109-460d-40f2-b0a9-b3bbfdba7085 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:55.845228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 787/1547] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:55 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:24:55.852065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853989-69f7-4cf3-b9fb-13a4ce0a1e8e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:55.869388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a98109-460d-40f2-b0a9-b3bbfdba7085 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:55.972938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853989-69f7-4cf3-b9fb-13a4ce0a1e8e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:55.982354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0722191-6559-435a-ae72-e0ef4990228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:55.983008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0722191-6559-435a-ae72-e0ef4990228c admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:55.983285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0722191-6559-435a-ae72-e0ef4990228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:55.983558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0722191-6559-435a-ae72-e0ef4990228c admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:55.985331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0722191-6559-435a-ae72-e0ef4990228c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:55.987813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0722191-6559-435a-ae72-e0ef4990228c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.024370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697c589-6bf7-4b89-8f28-0abe73a9dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.027285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697c589-6bf7-4b89-8f28-0abe73a9dde0 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.027285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697c589-6bf7-4b89-8f28-0abe73a9dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.027285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697c589-6bf7-4b89-8f28-0abe73a9dde0 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.027285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697c589-6bf7-4b89-8f28-0abe73a9dde0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.028612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: WARNING py.warnings [None req-1697c589-6bf7-4b89-8f28-0abe73a9dde0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:24:56.028612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: warnings.warn(msg) Aug 04 05:24:56.028612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: Aug 04 05:24:56.030235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697c589-6bf7-4b89-8f28-0abe73a9dde0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.092558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 788/1548] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:55 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:24:56.093537 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1fe2-feed-4ecf-b6b2-1c65210e3146 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.093984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1fe2-feed-4ecf-b6b2-1c65210e3146 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.094293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1fe2-feed-4ecf-b6b2-1c65210e3146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.127959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0fbf1fe2-feed-4ecf-b6b2-1c65210e3146 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.129540 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0fbf1fe2-feed-4ecf-b6b2-1c65210e3146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.145272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 789/1549] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.146236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf1fe2-feed-4ecf-b6b2-1c65210e3146 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.168519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf1fe2-feed-4ecf-b6b2-1c65210e3146 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.175870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4a4d1-8263-4b55-8dfc-f84bd84438fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.182220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a4d1-8263-4b55-8dfc-f84bd84438fa admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.182220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a4d1-8263-4b55-8dfc-f84bd84438fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.182220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a4d1-8263-4b55-8dfc-f84bd84438fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.182220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4a4d1-8263-4b55-8dfc-f84bd84438fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.182220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4a4d1-8263-4b55-8dfc-f84bd84438fa admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.189503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 761/1550] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:55 2022] POST /identity/v3/users => generated 303 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:24:56.191295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06258f5f-47fb-4d76-bdb8-5796abf1e7d9 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.191856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06258f5f-47fb-4d76-bdb8-5796abf1e7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.192373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06258f5f-47fb-4d76-bdb8-5796abf1e7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.202528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 790/1551] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:56.204082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fae71-28e1-48db-a79c-1b8260b51524 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.210224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fae71-28e1-48db-a79c-1b8260b51524 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.210224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fae71-28e1-48db-a79c-1b8260b51524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.234389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-06258f5f-47fb-4d76-bdb8-5796abf1e7d9 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.234389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-06258f5f-47fb-4d76-bdb8-5796abf1e7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.241387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-254fae71-28e1-48db-a79c-1b8260b51524 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.242754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-254fae71-28e1-48db-a79c-1b8260b51524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.249056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 762/1552] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.250287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06258f5f-47fb-4d76-bdb8-5796abf1e7d9 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.262649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 791/1553] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.263377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fae71-28e1-48db-a79c-1b8260b51524 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.269012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06258f5f-47fb-4d76-bdb8-5796abf1e7d9 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.281952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fae71-28e1-48db-a79c-1b8260b51524 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.282851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf402cb-e2c0-4d28-86c5-029f59f4e76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.283763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf402cb-e2c0-4d28-86c5-029f59f4e76b admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.284266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf402cb-e2c0-4d28-86c5-029f59f4e76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.284806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf402cb-e2c0-4d28-86c5-029f59f4e76b admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.286002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf402cb-e2c0-4d28-86c5-029f59f4e76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.287904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf402cb-e2c0-4d28-86c5-029f59f4e76b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.300316 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 763/1554] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:56.301501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313e2a5-60f9-4fc1-b249-ab1edcc0262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.301811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf402cb-e2c0-4d28-86c5-029f59f4e76b admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.302246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313e2a5-60f9-4fc1-b249-ab1edcc0262c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.302483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313e2a5-60f9-4fc1-b249-ab1edcc0262c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.302718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313e2a5-60f9-4fc1-b249-ab1edcc0262c admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.303725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313e2a5-60f9-4fc1-b249-ab1edcc0262c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.308734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313e2a5-60f9-4fc1-b249-ab1edcc0262c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.331384 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf402cb-e2c0-4d28-86c5-029f59f4e76b admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.332121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 792/1555] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:56.333612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fb22f-58c6-4ac8-bd96-6631154cf765 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.333900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fb22f-58c6-4ac8-bd96-6631154cf765 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.334179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fb22f-58c6-4ac8-bd96-6631154cf765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.344332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84addfe2-4956-45fb-a64f-66ac2547be89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.344976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84addfe2-4956-45fb-a64f-66ac2547be89 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.345253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84addfe2-4956-45fb-a64f-66ac2547be89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.345576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84addfe2-4956-45fb-a64f-66ac2547be89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.346296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84addfe2-4956-45fb-a64f-66ac2547be89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:56.346639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84addfe2-4956-45fb-a64f-66ac2547be89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.348278 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84addfe2-4956-45fb-a64f-66ac2547be89 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.367824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 764/1556] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:56.369480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decfea-9623-4fe0-9133-c70dfcd61272 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.369705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ef6fb22f-58c6-4ac8-bd96-6631154cf765 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.370222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decfea-9623-4fe0-9133-c70dfcd61272 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.370817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decfea-9623-4fe0-9133-c70dfcd61272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.371584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ef6fb22f-58c6-4ac8-bd96-6631154cf765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.381302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 793/1557] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.382195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fb22f-58c6-4ac8-bd96-6631154cf765 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.393605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fb22f-58c6-4ac8-bd96-6631154cf765 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.398422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88904089-de32-4773-8194-bec2558b9e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.399039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88904089-de32-4773-8194-bec2558b9e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.399314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88904089-de32-4773-8194-bec2558b9e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.399586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88904089-de32-4773-8194-bec2558b9e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.400021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e5decfea-9623-4fe0-9133-c70dfcd61272 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.400499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88904089-de32-4773-8194-bec2558b9e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.401231 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e5decfea-9623-4fe0-9133-c70dfcd61272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.402722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88904089-de32-4773-8194-bec2558b9e94 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.410124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 765/1558] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.411378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decfea-9623-4fe0-9133-c70dfcd61272 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.415341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 794/1559] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:56.416788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bce05-b7cb-48f2-ad16-daccc4879189 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.416788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bce05-b7cb-48f2-ad16-daccc4879189 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.417367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bce05-b7cb-48f2-ad16-daccc4879189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.421679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decfea-9623-4fe0-9133-c70dfcd61272 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.426645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc1e90-797d-4258-9326-0026ccc5bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.427536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1e90-797d-4258-9326-0026ccc5bab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.429202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1e90-797d-4258-9326-0026ccc5bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.429202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1e90-797d-4258-9326-0026ccc5bab1 admin admin] PATH_INFO: `/v3/projects/faead990837d43de8ec54bfaf24361de/users/9cb49b631c234f9a9fd47049b9b2e097/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.431357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:56.437951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b01bce05-b7cb-48f2-ad16-daccc4879189 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.439213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b01bce05-b7cb-48f2-ad16-daccc4879189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.445482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc1e90-797d-4258-9326-0026ccc5bab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faead990837d43de8ec54bfaf24361de, user_id=9cb49b631c234f9a9fd47049b9b2e097, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.448318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 795/1560] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.454382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc1e90-797d-4258-9326-0026ccc5bab1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.454675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bce05-b7cb-48f2-ad16-daccc4879189 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.466791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bce05-b7cb-48f2-ad16-daccc4879189 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.471891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc6fd0-f624-4ce5-b720-39b6b73d0679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.472526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6fd0-f624-4ce5-b720-39b6b73d0679 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.472808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6fd0-f624-4ce5-b720-39b6b73d0679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.473086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6fd0-f624-4ce5-b720-39b6b73d0679 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.473876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc6fd0-f624-4ce5-b720-39b6b73d0679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.475817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc6fd0-f624-4ce5-b720-39b6b73d0679 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.521669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 766/1561] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:56 2022] PUT /identity/v3/projects/faead990837d43de8ec54bfaf24361de/users/9cb49b631c234f9a9fd47049b9b2e097/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:56.522926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38affe46-c277-4e4b-8252-e81815283f3b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.523207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38affe46-c277-4e4b-8252-e81815283f3b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.523501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38affe46-c277-4e4b-8252-e81815283f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.543405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-38affe46-c277-4e4b-8252-e81815283f3b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.545247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-38affe46-c277-4e4b-8252-e81815283f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.609351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 767/1562] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.611021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52d840-16d4-4799-b531-2405fd428f1d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.611160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52d840-16d4-4799-b531-2405fd428f1d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.611422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52d840-16d4-4799-b531-2405fd428f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.625369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 796/1563] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:56.626670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fc780-6ebf-43da-b5da-58aba934d989 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.627065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fc780-6ebf-43da-b5da-58aba934d989 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.627261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fc780-6ebf-43da-b5da-58aba934d989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.634480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ad52d840-16d4-4799-b531-2405fd428f1d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.636009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ad52d840-16d4-4799-b531-2405fd428f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.647429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-7b9fc780-6ebf-43da-b5da-58aba934d989 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.648639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7b9fc780-6ebf-43da-b5da-58aba934d989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.658285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:56.698168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 768/1564] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.703060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52d840-16d4-4799-b531-2405fd428f1d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.713162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52d840-16d4-4799-b531-2405fd428f1d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.716694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 797/1565] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.717299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fc780-6ebf-43da-b5da-58aba934d989 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.719438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f48e5a-445d-4d44-9f40-386a5e61656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.720080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f48e5a-445d-4d44-9f40-386a5e61656e admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.720361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f48e5a-445d-4d44-9f40-386a5e61656e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.720637 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f48e5a-445d-4d44-9f40-386a5e61656e admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.721387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f48e5a-445d-4d44-9f40-386a5e61656e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:56.721664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f48e5a-445d-4d44-9f40-386a5e61656e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.723510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f48e5a-445d-4d44-9f40-386a5e61656e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.731432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fc780-6ebf-43da-b5da-58aba934d989 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.744870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 769/1566] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:56.745101 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cae4a-c722-43d6-bd57-a7e5c7a4118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.745217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fb053-86c0-476c-be9f-b850e33c01f5 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.745891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cae4a-c722-43d6-bd57-a7e5c7a4118c admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.745980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fb053-86c0-476c-be9f-b850e33c01f5 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.746065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cae4a-c722-43d6-bd57-a7e5c7a4118c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.746151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fb053-86c0-476c-be9f-b850e33c01f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.746239 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cae4a-c722-43d6-bd57-a7e5c7a4118c admin admin] PATH_INFO: `/v3/projects/37fc18d6212f4e1d91eb2db38659f154/users/fe607d136dc04cd7a5ab4fcbd310c547/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.756909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cae4a-c722-43d6-bd57-a7e5c7a4118c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fc18d6212f4e1d91eb2db38659f154, user_id=fe607d136dc04cd7a5ab4fcbd310c547, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.757951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WARNING py.warnings [None req-977cae4a-c722-43d6-bd57-a7e5c7a4118c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:24:56.757951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: warnings.warn(msg) Aug 04 05:24:56.757951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: Aug 04 05:24:56.759377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-bb9fb053-86c0-476c-be9f-b850e33c01f5 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.759924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cae4a-c722-43d6-bd57-a7e5c7a4118c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.760586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-bb9fb053-86c0-476c-be9f-b850e33c01f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.769671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 770/1567] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.778541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d3bb-c6a9-4e5a-915a-dc89dd1ee0d5 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.778541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d3bb-c6a9-4e5a-915a-dc89dd1ee0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.778541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d3bb-c6a9-4e5a-915a-dc89dd1ee0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.791073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-bc46d3bb-c6a9-4e5a-915a-dc89dd1ee0d5 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.792317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-bc46d3bb-c6a9-4e5a-915a-dc89dd1ee0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.800948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 771/1568] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.802540 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d7c2-a854-4cfc-bd20-fd4f01872f59 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.803078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d7c2-a854-4cfc-bd20-fd4f01872f59 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.803567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d7c2-a854-4cfc-bd20-fd4f01872f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.826970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-2da5d7c2-a854-4cfc-bd20-fd4f01872f59 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.828562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2da5d7c2-a854-4cfc-bd20-fd4f01872f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.837361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 798/1569] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:56 2022] PUT /identity/v3/projects/37fc18d6212f4e1d91eb2db38659f154/users/fe607d136dc04cd7a5ab4fcbd310c547/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:56.838450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cae4a-c722-43d6-bd57-a7e5c7a4118c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.893567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:56.902167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 772/1570] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.903101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5d7c2-a854-4cfc-bd20-fd4f01872f59 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.912715 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5d7c2-a854-4cfc-bd20-fd4f01872f59 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.916815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cae4a-c722-43d6-bd57-a7e5c7a4118c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.917549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea87f4-31f7-4698-b653-8cc5bddae0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.918377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea87f4-31f7-4698-b653-8cc5bddae0cf admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.918661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea87f4-31f7-4698-b653-8cc5bddae0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.918939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea87f4-31f7-4698-b653-8cc5bddae0cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.919718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea87f4-31f7-4698-b653-8cc5bddae0cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:56.920023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea87f4-31f7-4698-b653-8cc5bddae0cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.921607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea87f4-31f7-4698-b653-8cc5bddae0cf admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.922092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873eec2-17eb-4de7-a786-c1d5c1422516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.922728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873eec2-17eb-4de7-a786-c1d5c1422516 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.923004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873eec2-17eb-4de7-a786-c1d5c1422516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.923273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873eec2-17eb-4de7-a786-c1d5c1422516 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.923929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873eec2-17eb-4de7-a786-c1d5c1422516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.925874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873eec2-17eb-4de7-a786-c1d5c1422516 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:56.934264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 773/1571] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:56.935626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7587566-315e-4052-9b9c-1ae12f173817 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.935899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7587566-315e-4052-9b9c-1ae12f173817 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.936222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7587566-315e-4052-9b9c-1ae12f173817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.960787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d7587566-315e-4052-9b9c-1ae12f173817 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:56.961988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d7587566-315e-4052-9b9c-1ae12f173817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:56.970092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 774/1572] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:56.971101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7587566-315e-4052-9b9c-1ae12f173817 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:56.982057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7587566-315e-4052-9b9c-1ae12f173817 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:56.987137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb8ad7-8b57-4788-8e03-0db3b51328c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:56.987907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb8ad7-8b57-4788-8e03-0db3b51328c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:56.988186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb8ad7-8b57-4788-8e03-0db3b51328c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:56.988455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb8ad7-8b57-4788-8e03-0db3b51328c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:56.989133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb8ad7-8b57-4788-8e03-0db3b51328c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:56.991228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb8ad7-8b57-4788-8e03-0db3b51328c3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.023976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 799/1573] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:57.024933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873eec2-17eb-4de7-a786-c1d5c1422516 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.035999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873eec2-17eb-4de7-a786-c1d5c1422516 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.040570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0f218-ea17-4254-a968-aaa9b84eb69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.046201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0f218-ea17-4254-a968-aaa9b84eb69b admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.046201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0f218-ea17-4254-a968-aaa9b84eb69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.046201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0f218-ea17-4254-a968-aaa9b84eb69b admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.046201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0f218-ea17-4254-a968-aaa9b84eb69b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:57.046201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0f218-ea17-4254-a968-aaa9b84eb69b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.046201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0f218-ea17-4254-a968-aaa9b84eb69b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.059427 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 800/1574] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:57.060239 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0f218-ea17-4254-a968-aaa9b84eb69b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.106214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 775/1575] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:56 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:57.107765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae3a04-b760-4eaf-8f94-749953b253e8 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.108050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae3a04-b760-4eaf-8f94-749953b253e8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.108323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae3a04-b760-4eaf-8f94-749953b253e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.132163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0f218-ea17-4254-a968-aaa9b84eb69b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.139741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8aae3a04-b760-4eaf-8f94-749953b253e8 None None] MFA Rules not processed for user `fe607d136dc04cd7a5ab4fcbd310c547`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:57.140959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8aae3a04-b760-4eaf-8f94-749953b253e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:57.151746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:57.187956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e748f-67da-4025-a517-87b36f0e9733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.188587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e748f-67da-4025-a517-87b36f0e9733 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.189532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e748f-67da-4025-a517-87b36f0e9733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.190163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e748f-67da-4025-a517-87b36f0e9733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.218854 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 776/1576] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:57.219876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae3a04-b760-4eaf-8f94-749953b253e8 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.277408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e748f-67da-4025-a517-87b36f0e9733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.279355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e748f-67da-4025-a517-87b36f0e9733 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.295320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 801/1577] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:57.296758 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae3a04-b760-4eaf-8f94-749953b253e8 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.297104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e748f-67da-4025-a517-87b36f0e9733 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.301568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41db926-eaa6-4388-ad9f-e2e10cfeaf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.302200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41db926-eaa6-4388-ad9f-e2e10cfeaf0a admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.302512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41db926-eaa6-4388-ad9f-e2e10cfeaf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.302791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41db926-eaa6-4388-ad9f-e2e10cfeaf0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.303501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41db926-eaa6-4388-ad9f-e2e10cfeaf0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:57.303807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41db926-eaa6-4388-ad9f-e2e10cfeaf0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.305418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41db926-eaa6-4388-ad9f-e2e10cfeaf0a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.314232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e748f-67da-4025-a517-87b36f0e9733 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.320280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2f049-8c72-4e36-8e6f-2e529611a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.320912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2f049-8c72-4e36-8e6f-2e529611a320 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.321189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2f049-8c72-4e36-8e6f-2e529611a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.321463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2f049-8c72-4e36-8e6f-2e529611a320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.322254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2f049-8c72-4e36-8e6f-2e529611a320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.324178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2f049-8c72-4e36-8e6f-2e529611a320 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.328300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 777/1578] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:57.329152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41db926-eaa6-4388-ad9f-e2e10cfeaf0a admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.339605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41db926-eaa6-4388-ad9f-e2e10cfeaf0a admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.344918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e7dce-2687-4bb9-ae07-e3059edb2507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.345663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e7dce-2687-4bb9-ae07-e3059edb2507 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.346203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e7dce-2687-4bb9-ae07-e3059edb2507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.346647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e7dce-2687-4bb9-ae07-e3059edb2507 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.347636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e7dce-2687-4bb9-ae07-e3059edb2507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:57.348070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e7dce-2687-4bb9-ae07-e3059edb2507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.349951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e7dce-2687-4bb9-ae07-e3059edb2507 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.364511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 778/1579] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:57.365476 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e7dce-2687-4bb9-ae07-e3059edb2507 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.378261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e7dce-2687-4bb9-ae07-e3059edb2507 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.384737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9837d1d-1e31-460f-b687-87c325bfc3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.385511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9837d1d-1e31-460f-b687-87c325bfc3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.385797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9837d1d-1e31-460f-b687-87c325bfc3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.386252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9837d1d-1e31-460f-b687-87c325bfc3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.387099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9837d1d-1e31-460f-b687-87c325bfc3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.388973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9837d1d-1e31-460f-b687-87c325bfc3a3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.400267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 779/1580] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:57.403928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9837d1d-1e31-460f-b687-87c325bfc3a3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.412186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9837d1d-1e31-460f-b687-87c325bfc3a3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.417086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38b69-8528-4e6a-a327-e1914f899044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.418997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38b69-8528-4e6a-a327-e1914f899044 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.419258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38b69-8528-4e6a-a327-e1914f899044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.419529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38b69-8528-4e6a-a327-e1914f899044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.420207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e38b69-8528-4e6a-a327-e1914f899044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.422113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e38b69-8528-4e6a-a327-e1914f899044 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.432645 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 802/1581] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:57 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:57.434032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2f049-8c72-4e36-8e6f-2e529611a320 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.441186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:57.505072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2f049-8c72-4e36-8e6f-2e529611a320 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.510585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5fc8f-83db-464e-828d-86b73f39a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.511288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 780/1582] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:57 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:57.512077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5fc8f-83db-464e-828d-86b73f39a4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.512346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38b69-8528-4e6a-a327-e1914f899044 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.512473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5fc8f-83db-464e-828d-86b73f39a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.512828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5fc8f-83db-464e-828d-86b73f39a4a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.513615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5fc8f-83db-464e-828d-86b73f39a4a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.516845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5fc8f-83db-464e-828d-86b73f39a4a5 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.585500 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38b69-8528-4e6a-a327-e1914f899044 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.592678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5572ad-f4da-4450-a680-88f6918b6016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.593409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5572ad-f4da-4450-a680-88f6918b6016 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.593794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5572ad-f4da-4450-a680-88f6918b6016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.594047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5572ad-f4da-4450-a680-88f6918b6016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.594753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5572ad-f4da-4450-a680-88f6918b6016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.596694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5572ad-f4da-4450-a680-88f6918b6016 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.608713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 803/1583] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:57 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:57.609545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5fc8f-83db-464e-828d-86b73f39a4a5 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.620978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5fc8f-83db-464e-828d-86b73f39a4a5 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.626372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de33381-807f-4baa-9427-28de4388c875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.627080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de33381-807f-4baa-9427-28de4388c875 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.627442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de33381-807f-4baa-9427-28de4388c875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.627690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de33381-807f-4baa-9427-28de4388c875 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.628308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de33381-807f-4baa-9427-28de4388c875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.630381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de33381-807f-4baa-9427-28de4388c875 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.672006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 781/1584] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:57 2022] POST /identity/v3/projects => generated 403 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:57.672995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5572ad-f4da-4450-a680-88f6918b6016 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.755815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 804/1585] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:57 2022] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:57.755815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de33381-807f-4baa-9427-28de4388c875 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.758447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5572ad-f4da-4450-a680-88f6918b6016 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.781942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:57.825199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755d126-45a3-429d-b726-c43078fbbcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.825749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d126-45a3-429d-b726-c43078fbbcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.826027 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d126-45a3-429d-b726-c43078fbbcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.826301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d126-45a3-429d-b726-c43078fbbcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.826991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755d126-45a3-429d-b726-c43078fbbcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.828011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de33381-807f-4baa-9427-28de4388c875 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.828972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755d126-45a3-429d-b726-c43078fbbcf2 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.832700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ffb6e-5fb6-46fd-8c94-d1790fbd4519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.833437 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ffb6e-5fb6-46fd-8c94-d1790fbd4519 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.833626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ffb6e-5fb6-46fd-8c94-d1790fbd4519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.833903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ffb6e-5fb6-46fd-8c94-d1790fbd4519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.834648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ffb6e-5fb6-46fd-8c94-d1790fbd4519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.836243 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ffb6e-5fb6-46fd-8c94-d1790fbd4519 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.849202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 805/1586] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:57.850194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ffb6e-5fb6-46fd-8c94-d1790fbd4519 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.861535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ffb6e-5fb6-46fd-8c94-d1790fbd4519 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:57.866286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341ccc2-2cc5-4e59-8413-d2a12313c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:57.866918 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341ccc2-2cc5-4e59-8413-d2a12313c380 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:57.867195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341ccc2-2cc5-4e59-8413-d2a12313c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:57.867469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341ccc2-2cc5-4e59-8413-d2a12313c380 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:57.868153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341ccc2-2cc5-4e59-8413-d2a12313c380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:57.870057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341ccc2-2cc5-4e59-8413-d2a12313c380 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:57.928229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 782/1587] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:57 2022] POST /identity/v3/projects => generated 365 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:57.929223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755d126-45a3-429d-b726-c43078fbbcf2 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.944600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:57.976264 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 806/1588] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:57 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:57.977016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341ccc2-2cc5-4e59-8413-d2a12313c380 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:57.990373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341ccc2-2cc5-4e59-8413-d2a12313c380 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.008628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755d126-45a3-429d-b726-c43078fbbcf2 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.018888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c2258-dbf1-4e8f-a0cc-f9a724f0efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.023075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c2258-dbf1-4e8f-a0cc-f9a724f0efa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.023075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c2258-dbf1-4e8f-a0cc-f9a724f0efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.023075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c2258-dbf1-4e8f-a0cc-f9a724f0efa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.023075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c2258-dbf1-4e8f-a0cc-f9a724f0efa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.024728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c2258-dbf1-4e8f-a0cc-f9a724f0efa3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.078973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629ae50-d3f1-4ae4-a3ed-6fdf375c3177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.079683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629ae50-d3f1-4ae4-a3ed-6fdf375c3177 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.079965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629ae50-d3f1-4ae4-a3ed-6fdf375c3177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.080234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629ae50-d3f1-4ae4-a3ed-6fdf375c3177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.080940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629ae50-d3f1-4ae4-a3ed-6fdf375c3177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.082636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629ae50-d3f1-4ae4-a3ed-6fdf375c3177 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.098381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 807/1589] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.098381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629ae50-d3f1-4ae4-a3ed-6fdf375c3177 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.111214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629ae50-d3f1-4ae4-a3ed-6fdf375c3177 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.115908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fcb6c-04d9-461b-be8f-359f3196f904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.116513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fcb6c-04d9-461b-be8f-359f3196f904 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.116788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fcb6c-04d9-461b-be8f-359f3196f904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.117058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fcb6c-04d9-461b-be8f-359f3196f904 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.117710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fcb6c-04d9-461b-be8f-359f3196f904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.119687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fcb6c-04d9-461b-be8f-359f3196f904 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.144706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 783/1590] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:57 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:58.145528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c2258-dbf1-4e8f-a0cc-f9a724f0efa3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.156510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c2258-dbf1-4e8f-a0cc-f9a724f0efa3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.162187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581216cc-90bc-4105-9528-d8958009e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.163199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581216cc-90bc-4105-9528-d8958009e926 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.163486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581216cc-90bc-4105-9528-d8958009e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.163765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581216cc-90bc-4105-9528-d8958009e926 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.164665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581216cc-90bc-4105-9528-d8958009e926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.166827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581216cc-90bc-4105-9528-d8958009e926 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.246019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 808/1591] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:58 2022] POST /identity/v3/users => generated 308 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:58.248082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fcb6c-04d9-461b-be8f-359f3196f904 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.265831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fcb6c-04d9-461b-be8f-359f3196f904 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.271687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906eb0fc-9da1-4977-a734-fb5dd402d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.272458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906eb0fc-9da1-4977-a734-fb5dd402d23f admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.272752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906eb0fc-9da1-4977-a734-fb5dd402d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.273129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906eb0fc-9da1-4977-a734-fb5dd402d23f admin admin] PATH_INFO: `/v3/projects/3f2e49b8bd774498b36adb76f17c4798/users/e6a9276d2d804791bb4582b7775bd5b9/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.291864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906eb0fc-9da1-4977-a734-fb5dd402d23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2e49b8bd774498b36adb76f17c4798, user_id=e6a9276d2d804791bb4582b7775bd5b9, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.295278 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906eb0fc-9da1-4977-a734-fb5dd402d23f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.304865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 784/1592] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:58 2022] POST /identity/v3/users => generated 279 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:58.305826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581216cc-90bc-4105-9528-d8958009e926 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.317109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581216cc-90bc-4105-9528-d8958009e926 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.321897 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586a4c1-a31e-4c6b-b1a3-87026e42fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.322546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586a4c1-a31e-4c6b-b1a3-87026e42fa93 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.322826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586a4c1-a31e-4c6b-b1a3-87026e42fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.323099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586a4c1-a31e-4c6b-b1a3-87026e42fa93 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.323811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586a4c1-a31e-4c6b-b1a3-87026e42fa93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.325720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586a4c1-a31e-4c6b-b1a3-87026e42fa93 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.378744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 809/1593] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:58 2022] PUT /identity/v3/projects/3f2e49b8bd774498b36adb76f17c4798/users/e6a9276d2d804791bb4582b7775bd5b9/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:58.379718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906eb0fc-9da1-4977-a734-fb5dd402d23f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.433636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 785/1594] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:58 2022] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:58.433636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586a4c1-a31e-4c6b-b1a3-87026e42fa93 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.440300 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:58.445054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586a4c1-a31e-4c6b-b1a3-87026e42fa93 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.450599 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd0c2d-bf48-4801-a88e-396d7406b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.451228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd0c2d-bf48-4801-a88e-396d7406b7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.451536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd0c2d-bf48-4801-a88e-396d7406b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.451875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd0c2d-bf48-4801-a88e-396d7406b7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.452587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd0c2d-bf48-4801-a88e-396d7406b7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.452730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906eb0fc-9da1-4977-a734-fb5dd402d23f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.454201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd0c2d-bf48-4801-a88e-396d7406b7f1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.459273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dae94-c047-4fec-900a-6a345694e8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.460435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dae94-c047-4fec-900a-6a345694e8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.460969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dae94-c047-4fec-900a-6a345694e8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.461345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dae94-c047-4fec-900a-6a345694e8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.462271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39dae94-c047-4fec-900a-6a345694e8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.465775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39dae94-c047-4fec-900a-6a345694e8c8 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.467169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 786/1595] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.471650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd0c2d-bf48-4801-a88e-396d7406b7f1 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.481412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 810/1596] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.482851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dae94-c047-4fec-900a-6a345694e8c8 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.483838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd0c2d-bf48-4801-a88e-396d7406b7f1 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.489220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0633a3d-602b-4ab4-a1a5-565cd0672659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.490049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0633a3d-602b-4ab4-a1a5-565cd0672659 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.490282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0633a3d-602b-4ab4-a1a5-565cd0672659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.490584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0633a3d-602b-4ab4-a1a5-565cd0672659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.491354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0633a3d-602b-4ab4-a1a5-565cd0672659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.493146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0633a3d-602b-4ab4-a1a5-565cd0672659 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.493979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dae94-c047-4fec-900a-6a345694e8c8 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.499938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb606fda-54ee-4fd4-ac08-5e717bb139c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.500565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb606fda-54ee-4fd4-ac08-5e717bb139c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.500864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb606fda-54ee-4fd4-ac08-5e717bb139c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.501325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb606fda-54ee-4fd4-ac08-5e717bb139c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.502045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb606fda-54ee-4fd4-ac08-5e717bb139c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.504517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb606fda-54ee-4fd4-ac08-5e717bb139c0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.506781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 787/1597] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.508092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0633a3d-602b-4ab4-a1a5-565cd0672659 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.519596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 811/1598] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.521451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0633a3d-602b-4ab4-a1a5-565cd0672659 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.521666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11e9aa-3208-4bfa-90a1-f6efa01ecaa1 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.524470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11e9aa-3208-4bfa-90a1-f6efa01ecaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.524470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11e9aa-3208-4bfa-90a1-f6efa01ecaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.528555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e55ad-fe57-4981-ae56-08e3fd1c4be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.529272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e55ad-fe57-4981-ae56-08e3fd1c4be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.529553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e55ad-fe57-4981-ae56-08e3fd1c4be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.529906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e55ad-fe57-4981-ae56-08e3fd1c4be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.530715 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e55ad-fe57-4981-ae56-08e3fd1c4be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.532550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e55ad-fe57-4981-ae56-08e3fd1c4be3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.545484 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 788/1599] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.547405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e55ad-fe57-4981-ae56-08e3fd1c4be3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.560334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e55ad-fe57-4981-ae56-08e3fd1c4be3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.562114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-8d11e9aa-3208-4bfa-90a1-f6efa01ecaa1 None None] MFA Rules not processed for user `e6a9276d2d804791bb4582b7775bd5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:58.563669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8d11e9aa-3208-4bfa-90a1-f6efa01ecaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:58.565723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bc3e2-5e17-4fcb-815c-b9944e7f1d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.566343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc3e2-5e17-4fcb-815c-b9944e7f1d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.566640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc3e2-5e17-4fcb-815c-b9944e7f1d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.566921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc3e2-5e17-4fcb-815c-b9944e7f1d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.567639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bc3e2-5e17-4fcb-815c-b9944e7f1d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.569586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bc3e2-5e17-4fcb-815c-b9944e7f1d83 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.588382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 789/1600] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.588382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bc3e2-5e17-4fcb-815c-b9944e7f1d83 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.600681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bc3e2-5e17-4fcb-815c-b9944e7f1d83 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.608446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d214dd3-ad1c-45e3-a488-154e4222df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.609433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d214dd3-ad1c-45e3-a488-154e4222df76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.609877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d214dd3-ad1c-45e3-a488-154e4222df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.610383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d214dd3-ad1c-45e3-a488-154e4222df76 admin admin] PATH_INFO: `/v3/projects/b62d19c831574f9b99c993b5e41c645d/users/ab8f887f5689419e9e31a0ba43f76ada/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.637219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d214dd3-ad1c-45e3-a488-154e4222df76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62d19c831574f9b99c993b5e41c645d, user_id=ab8f887f5689419e9e31a0ba43f76ada, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.642505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d214dd3-ad1c-45e3-a488-154e4222df76 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.661544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 812/1601] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:58.662471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11e9aa-3208-4bfa-90a1-f6efa01ecaa1 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.674535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11e9aa-3208-4bfa-90a1-f6efa01ecaa1 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.679378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b47947-bea7-4c5b-8d16-0a83477cdd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.679999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b47947-bea7-4c5b-8d16-0a83477cdd98 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.680312 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b47947-bea7-4c5b-8d16-0a83477cdd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.680541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b47947-bea7-4c5b-8d16-0a83477cdd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.681233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b47947-bea7-4c5b-8d16-0a83477cdd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.682929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b47947-bea7-4c5b-8d16-0a83477cdd98 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.694332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 813/1602] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.695222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b47947-bea7-4c5b-8d16-0a83477cdd98 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.707655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b47947-bea7-4c5b-8d16-0a83477cdd98 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.722860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d81d9-90e2-4fdb-9385-0fc2e06d5863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.723519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d81d9-90e2-4fdb-9385-0fc2e06d5863 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.723798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d81d9-90e2-4fdb-9385-0fc2e06d5863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.724078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d81d9-90e2-4fdb-9385-0fc2e06d5863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.724803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d81d9-90e2-4fdb-9385-0fc2e06d5863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.726479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d81d9-90e2-4fdb-9385-0fc2e06d5863 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.738625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 814/1603] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.739472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d81d9-90e2-4fdb-9385-0fc2e06d5863 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.751748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 790/1604] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:58 2022] PUT /identity/v3/projects/b62d19c831574f9b99c993b5e41c645d/users/ab8f887f5689419e9e31a0ba43f76ada/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:58.752494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d81d9-90e2-4fdb-9385-0fc2e06d5863 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.752841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d214dd3-ad1c-45e3-a488-154e4222df76 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.812805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672270a-1d32-4723-bbec-ea73d13a8d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.813475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672270a-1d32-4723-bbec-ea73d13a8d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.813752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672270a-1d32-4723-bbec-ea73d13a8d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.814026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672270a-1d32-4723-bbec-ea73d13a8d66 admin admin] PATH_INFO: `/v3/projects/dd0be234a5924389970aaf99c3877a75/users/ed55efd8bcf34aa29d54ec62cc24de80/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.819509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d214dd3-ad1c-45e3-a488-154e4222df76 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.824736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc94a69-7594-4838-b4aa-4dedf7f479b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.825437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94a69-7594-4838-b4aa-4dedf7f479b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.825714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94a69-7594-4838-b4aa-4dedf7f479b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.825985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94a69-7594-4838-b4aa-4dedf7f479b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.826724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc94a69-7594-4838-b4aa-4dedf7f479b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.828437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc94a69-7594-4838-b4aa-4dedf7f479b6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.829895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:58.830338 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672270a-1d32-4723-bbec-ea73d13a8d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0be234a5924389970aaf99c3877a75, user_id=ed55efd8bcf34aa29d54ec62cc24de80, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.833021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672270a-1d32-4723-bbec-ea73d13a8d66 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.840038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 791/1605] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.844514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc94a69-7594-4838-b4aa-4dedf7f479b6 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.851018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc94a69-7594-4838-b4aa-4dedf7f479b6 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.856820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8b739-c6df-4f44-8a3e-b36e7a740f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.857454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b739-c6df-4f44-8a3e-b36e7a740f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.857728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b739-c6df-4f44-8a3e-b36e7a740f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.857999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b739-c6df-4f44-8a3e-b36e7a740f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.858739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8b739-c6df-4f44-8a3e-b36e7a740f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.860415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8b739-c6df-4f44-8a3e-b36e7a740f09 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.877950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 792/1606] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:58.877950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8b739-c6df-4f44-8a3e-b36e7a740f09 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.890617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8b739-c6df-4f44-8a3e-b36e7a740f09 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:58.896291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf41c7-fcd8-47ee-bcba-f00a02061b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:58.897023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf41c7-fcd8-47ee-bcba-f00a02061b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:58.897274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf41c7-fcd8-47ee-bcba-f00a02061b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:58.897571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf41c7-fcd8-47ee-bcba-f00a02061b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:58.899115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf41c7-fcd8-47ee-bcba-f00a02061b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:58.901158 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf41c7-fcd8-47ee-bcba-f00a02061b35 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:58.934730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 815/1607] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:58 2022] PUT /identity/v3/projects/dd0be234a5924389970aaf99c3877a75/users/ed55efd8bcf34aa29d54ec62cc24de80/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:58.935577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672270a-1d32-4723-bbec-ea73d13a8d66 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:58.968210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:59.021012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 793/1608] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:58 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:59.021012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf41c7-fcd8-47ee-bcba-f00a02061b35 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:59.035053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672270a-1d32-4723-bbec-ea73d13a8d66 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:59.096562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf41c7-fcd8-47ee-bcba-f00a02061b35 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:59.106681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515b40f-2fbb-4bfc-a338-c2859f503bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:59.107640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515b40f-2fbb-4bfc-a338-c2859f503bff admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.107912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515b40f-2fbb-4bfc-a338-c2859f503bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.108155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515b40f-2fbb-4bfc-a338-c2859f503bff admin admin] PATH_INFO: `/v3/projects/bd41986c224f414b8768675f40682380/users/e916e4e0fb7140b0912e9233898a0016/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.116055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477eb2-6b19-4083-96a9-6f9d800e909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:59.117616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477eb2-6b19-4083-96a9-6f9d800e909b admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.118109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477eb2-6b19-4083-96a9-6f9d800e909b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.121677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477eb2-6b19-4083-96a9-6f9d800e909b admin admin] PATH_INFO: `/v3/projects/820b25adb06d4245b9782065161f70b3/users/a4c17d030bc245a18605be1d10f12419/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.132773 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515b40f-2fbb-4bfc-a338-c2859f503bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd41986c224f414b8768675f40682380, user_id=e916e4e0fb7140b0912e9233898a0016, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:59.136189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515b40f-2fbb-4bfc-a338-c2859f503bff admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:59.142923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f477eb2-6b19-4083-96a9-6f9d800e909b admin admin] RBAC: Authorizing `identity:create_grant(project_id=820b25adb06d4245b9782065161f70b3, user_id=a4c17d030bc245a18605be1d10f12419, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:59.145790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f477eb2-6b19-4083-96a9-6f9d800e909b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:59.205001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 794/1609] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:59 2022] PUT /identity/v3/projects/bd41986c224f414b8768675f40682380/users/e916e4e0fb7140b0912e9233898a0016/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:59.207328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cf749-bc05-43bb-b4da-32577feeb958 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.207820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cf749-bc05-43bb-b4da-32577feeb958 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.208328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cf749-bc05-43bb-b4da-32577feeb958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.238357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 816/1610] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:58 2022] PUT /identity/v3/projects/820b25adb06d4245b9782065161f70b3/users/a4c17d030bc245a18605be1d10f12419/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:59.239431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-0c4cf749-bc05-43bb-b4da-32577feeb958 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:59.239664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477eb2-6b19-4083-96a9-6f9d800e909b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:59.240673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0c4cf749-bc05-43bb-b4da-32577feeb958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:59.325735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 795/1611] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:59.325735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cf749-bc05-43bb-b4da-32577feeb958 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:59.335603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cf749-bc05-43bb-b4da-32577feeb958 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:59.336814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477eb2-6b19-4083-96a9-6f9d800e909b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:59.342382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c17d1-90a1-43c7-b7ee-6be968b96d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:59.342846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ca6a7-9bd8-4e48-9d2e-1afcae55a34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:59.343215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c17d1-90a1-43c7-b7ee-6be968b96d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.343561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c17d1-90a1-43c7-b7ee-6be968b96d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.343678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ca6a7-9bd8-4e48-9d2e-1afcae55a34c admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.343957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c17d1-90a1-43c7-b7ee-6be968b96d1d admin admin] PATH_INFO: `/v3/projects/3f2966fde4034c0aae9d1814d5dd01dc/users/67a0ea0d8987485aaa91ca2670608ba4/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.344083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ca6a7-9bd8-4e48-9d2e-1afcae55a34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.344847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ca6a7-9bd8-4e48-9d2e-1afcae55a34c admin admin] PATH_INFO: `/v3/projects/cb23bca3b73a462f9081b3be1513d437/users/3135c7d1fc554a9db9d809a45442737a/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.363709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c17d1-90a1-43c7-b7ee-6be968b96d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2966fde4034c0aae9d1814d5dd01dc, user_id=67a0ea0d8987485aaa91ca2670608ba4, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:59.366628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c17d1-90a1-43c7-b7ee-6be968b96d1d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:59.369631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ca6a7-9bd8-4e48-9d2e-1afcae55a34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb23bca3b73a462f9081b3be1513d437, user_id=3135c7d1fc554a9db9d809a45442737a, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:59.373258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ca6a7-9bd8-4e48-9d2e-1afcae55a34c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:59.441137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 796/1612] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:59 2022] PUT /identity/v3/projects/3f2966fde4034c0aae9d1814d5dd01dc/users/67a0ea0d8987485aaa91ca2670608ba4/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:59.443156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c17d1-90a1-43c7-b7ee-6be968b96d1d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:59.490539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 817/1613] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:59 2022] PUT /identity/v3/projects/cb23bca3b73a462f9081b3be1513d437/users/3135c7d1fc554a9db9d809a45442737a/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:59.490539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ca6a7-9bd8-4e48-9d2e-1afcae55a34c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:59.493192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:59.538723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:59.539342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c17d1-90a1-43c7-b7ee-6be968b96d1d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:59.564003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ca6a7-9bd8-4e48-9d2e-1afcae55a34c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:59.569734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f6fc4-5f92-4df0-bee2-be7cd4623faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:59.570251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f6fc4-5f92-4df0-bee2-be7cd4623faf admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.579289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f6fc4-5f92-4df0-bee2-be7cd4623faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.579289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f6fc4-5f92-4df0-bee2-be7cd4623faf admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.579289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f6fc4-5f92-4df0-bee2-be7cd4623faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:59.579289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f6fc4-5f92-4df0-bee2-be7cd4623faf admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:59.640315 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1348968-1149-4db6-ac88-444ce4e69155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:59.641047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348968-1149-4db6-ac88-444ce4e69155 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.641401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348968-1149-4db6-ac88-444ce4e69155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.641774 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348968-1149-4db6-ac88-444ce4e69155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.642745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1348968-1149-4db6-ac88-444ce4e69155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:59.644624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1348968-1149-4db6-ac88-444ce4e69155 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:59.665642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 797/1614] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:59.668503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78722880-46dc-4ab6-871e-125b9374f7a4 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.668994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78722880-46dc-4ab6-871e-125b9374f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.669520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78722880-46dc-4ab6-871e-125b9374f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.690098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 818/1615] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:59 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:59.690098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1a87-dc6f-4bd8-aabd-914d4419126c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.690098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1a87-dc6f-4bd8-aabd-914d4419126c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.690098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1a87-dc6f-4bd8-aabd-914d4419126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.700272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-78722880-46dc-4ab6-871e-125b9374f7a4 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:59.702123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-78722880-46dc-4ab6-871e-125b9374f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:59.711037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 798/1616] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:59.712448 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78722880-46dc-4ab6-871e-125b9374f7a4 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:59.714734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-78722880-46dc-4ab6-871e-125b9374f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:59.733495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ed7f1a87-dc6f-4bd8-aabd-914d4419126c None None] MFA Rules not processed for user `a4c17d030bc245a18605be1d10f12419`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:59.735192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ed7f1a87-dc6f-4bd8-aabd-914d4419126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:59.795806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78722880-46dc-4ab6-871e-125b9374f7a4 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:59.800111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc90f10-959f-4f13-8b86-fe005d825206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:59.800754 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc90f10-959f-4f13-8b86-fe005d825206 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.801152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc90f10-959f-4f13-8b86-fe005d825206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.801318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc90f10-959f-4f13-8b86-fe005d825206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.811689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc90f10-959f-4f13-8b86-fe005d825206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:59.813154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc90f10-959f-4f13-8b86-fe005d825206 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:59.824381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 799/1617] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:59.825798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d521-03af-4fdc-b9d3-2fd6b08bd5b8 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.826091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d521-03af-4fdc-b9d3-2fd6b08bd5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.826439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d521-03af-4fdc-b9d3-2fd6b08bd5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.836395 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 819/1618] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:59.838065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f22ec-b1cc-42c2-b723-0fe9f2909805 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:59.838572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f22ec-b1cc-42c2-b723-0fe9f2909805 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:59.840023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f22ec-b1cc-42c2-b723-0fe9f2909805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:59.863377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b558d521-03af-4fdc-b9d3-2fd6b08bd5b8 None None] MFA Rules not processed for user `67a0ea0d8987485aaa91ca2670608ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:59.866554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b558d521-03af-4fdc-b9d3-2fd6b08bd5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:59.888398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-319f22ec-b1cc-42c2-b723-0fe9f2909805 None None] MFA Rules not processed for user `3135c7d1fc554a9db9d809a45442737a`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:59.889832 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-319f22ec-b1cc-42c2-b723-0fe9f2909805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:59.978728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:00.015800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 800/1619] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:00.021309 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d521-03af-4fdc-b9d3-2fd6b08bd5b8 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:00.036258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 820/1620] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:00.037411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f22ec-b1cc-42c2-b723-0fe9f2909805 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:00.041383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d521-03af-4fdc-b9d3-2fd6b08bd5b8 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:00.047940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8ddb0-4abb-4242-a039-83efb82e93b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:00.049051 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ddb0-4abb-4242-a039-83efb82e93b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:00.049548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ddb0-4abb-4242-a039-83efb82e93b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:00.050286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ddb0-4abb-4242-a039-83efb82e93b3 admin admin] PATH_INFO: `/v3/projects/dd0be234a5924389970aaf99c3877a75/users/ed55efd8bcf34aa29d54ec62cc24de80/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:00.051311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f22ec-b1cc-42c2-b723-0fe9f2909805 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:00.053102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8ddb0-4abb-4242-a039-83efb82e93b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0be234a5924389970aaf99c3877a75, user_id=ed55efd8bcf34aa29d54ec62cc24de80, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:00.056786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8ddb0-4abb-4242-a039-83efb82e93b3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:00.059812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225c5b6-895a-4565-bd1f-031947a4a97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:00.061640 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225c5b6-895a-4565-bd1f-031947a4a97c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:00.061986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225c5b6-895a-4565-bd1f-031947a4a97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:00.062435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225c5b6-895a-4565-bd1f-031947a4a97c admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:00.063703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225c5b6-895a-4565-bd1f-031947a4a97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:00.071839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225c5b6-895a-4565-bd1f-031947a4a97c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:00.075244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 801/1621] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:00 2022] PUT /identity/v3/projects/dd0be234a5924389970aaf99c3877a75/users/ed55efd8bcf34aa29d54ec62cc24de80/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:00.076785 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8ddb0-4abb-4242-a039-83efb82e93b3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:00.089177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 821/1622] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:00.091157 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016fffd-3c5c-42a1-9a07-739ccff131fd None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:00.091450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016fffd-3c5c-42a1-9a07-739ccff131fd None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:00.091704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016fffd-3c5c-42a1-9a07-739ccff131fd None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:00.101361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 822/1623] 10.222.0.46 () {54 vars in 962 bytes} [Thu Aug 4 05:25:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:25:00.107914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016fffd-3c5c-42a1-9a07-739ccff131fd None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:00.178690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:00.179837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8ddb0-4abb-4242-a039-83efb82e93b3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:00.184907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d048d-9005-4219-a2b6-740dddf94349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:00.185805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d048d-9005-4219-a2b6-740dddf94349 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:00.185942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d048d-9005-4219-a2b6-740dddf94349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:00.186141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d048d-9005-4219-a2b6-740dddf94349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:00.363838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016fffd-3c5c-42a1-9a07-739ccff131fd None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:00.363838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd423ae0-bafb-49e7-9d02-c12c3172dcd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:00.363838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd423ae0-bafb-49e7-9d02-c12c3172dcd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:00.363838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd423ae0-bafb-49e7-9d02-c12c3172dcd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:00.364795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd423ae0-bafb-49e7-9d02-c12c3172dcd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:00.365477 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d048d-9005-4219-a2b6-740dddf94349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:00.365477 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d048d-9005-4219-a2b6-740dddf94349 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:00.374792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd423ae0-bafb-49e7-9d02-c12c3172dcd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:00.374792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd423ae0-bafb-49e7-9d02-c12c3172dcd3 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:00.391947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 802/1624] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:00.393608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d048d-9005-4219-a2b6-740dddf94349 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:00.394716 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 823/1625] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:00.396479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59364-5454-4da0-ba8f-cd7951c53da6 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:00.396834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59364-5454-4da0-ba8f-cd7951c53da6 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:00.397185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59364-5454-4da0-ba8f-cd7951c53da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:00.429840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d048d-9005-4219-a2b6-740dddf94349 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:00.448238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a171f2f-f3ae-4a86-b28e-2be08ba03a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:00.450510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a171f2f-f3ae-4a86-b28e-2be08ba03a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:00.450955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a171f2f-f3ae-4a86-b28e-2be08ba03a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:00.452029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a171f2f-f3ae-4a86-b28e-2be08ba03a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:00.452733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a171f2f-f3ae-4a86-b28e-2be08ba03a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:00.460363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a171f2f-f3ae-4a86-b28e-2be08ba03a0e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:00.463325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3ba59364-5454-4da0-ba8f-cd7951c53da6 None None] MFA Rules not processed for user `ed55efd8bcf34aa29d54ec62cc24de80`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:00.465329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3ba59364-5454-4da0-ba8f-cd7951c53da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:00.606845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 824/1626] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:00 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:00.607986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59364-5454-4da0-ba8f-cd7951c53da6 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:00.621542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59364-5454-4da0-ba8f-cd7951c53da6 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:00.643046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 803/1627] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:00 2022] POST /identity/v3/projects => generated 355 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:00.643046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4ee9e-1b9c-47fb-808d-5dd7853fb1cb None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:00.643046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4ee9e-1b9c-47fb-808d-5dd7853fb1cb None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:00.643046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4ee9e-1b9c-47fb-808d-5dd7853fb1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:00.648345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974adc3f-2347-4d10-96a8-a5807f380431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:00.649188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974adc3f-2347-4d10-96a8-a5807f380431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:00.653350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974adc3f-2347-4d10-96a8-a5807f380431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:00.653350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974adc3f-2347-4d10-96a8-a5807f380431 admin admin] PATH_INFO: `/v3/projects/3493ad30388949298437d5caa35d08d3/users/37aa7165bb5749d5bffcdb116bfde57a/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:00.695850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974adc3f-2347-4d10-96a8-a5807f380431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3493ad30388949298437d5caa35d08d3, user_id=37aa7165bb5749d5bffcdb116bfde57a, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:00.706500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974adc3f-2347-4d10-96a8-a5807f380431 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:00.785891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-eae4ee9e-1b9c-47fb-808d-5dd7853fb1cb None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:00.787249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-eae4ee9e-1b9c-47fb-808d-5dd7853fb1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:00.880491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 825/1628] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:00 2022] PUT /identity/v3/projects/3493ad30388949298437d5caa35d08d3/users/37aa7165bb5749d5bffcdb116bfde57a/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:00.881863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974adc3f-2347-4d10-96a8-a5807f380431 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:00.936697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:00.977645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 804/1629] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Aug 4 05:25:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:00.983479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4ee9e-1b9c-47fb-808d-5dd7853fb1cb None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:01.128065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974adc3f-2347-4d10-96a8-a5807f380431 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:01.134673 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9a5b1-bb95-4a3b-923c-579ed329065f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:01.138265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9a5b1-bb95-4a3b-923c-579ed329065f service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.138752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9a5b1-bb95-4a3b-923c-579ed329065f service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.139655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9a5b1-bb95-4a3b-923c-579ed329065f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.145446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4ee9e-1b9c-47fb-808d-5dd7853fb1cb None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:01.150350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:01.262889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee519684-c185-4046-a6a4-6386e2132c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:01.263573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee519684-c185-4046-a6a4-6386e2132c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.266716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee519684-c185-4046-a6a4-6386e2132c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.269287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee519684-c185-4046-a6a4-6386e2132c54 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.270119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee519684-c185-4046-a6a4-6386e2132c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:01.270480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9a5b1-bb95-4a3b-923c-579ed329065f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:01.272251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9a5b1-bb95-4a3b-923c-579ed329065f service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:01.274423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee519684-c185-4046-a6a4-6386e2132c54 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:01.300555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 826/1630] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:00 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:01.304699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9a5b1-bb95-4a3b-923c-579ed329065f service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:01.320897 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9a5b1-bb95-4a3b-923c-579ed329065f service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:01.339573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579a77-7268-4760-b295-78e87df14397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:01.340224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579a77-7268-4760-b295-78e87df14397 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.340586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579a77-7268-4760-b295-78e87df14397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.340920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579a77-7268-4760-b295-78e87df14397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.341649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2579a77-7268-4760-b295-78e87df14397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:01.344213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2579a77-7268-4760-b295-78e87df14397 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:01.379522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 827/1631] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:01.379522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579a77-7268-4760-b295-78e87df14397 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:01.396597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 805/1632] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:00 2022] POST /identity/v3/users => generated 284 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:01.397346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee519684-c185-4046-a6a4-6386e2132c54 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:01.425201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee519684-c185-4046-a6a4-6386e2132c54 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:01.439063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fd29c-e37c-43e5-919f-70f6f97d9552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:01.440011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fd29c-e37c-43e5-919f-70f6f97d9552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.440394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fd29c-e37c-43e5-919f-70f6f97d9552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.440877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fd29c-e37c-43e5-919f-70f6f97d9552 admin admin] PATH_INFO: `/v3/projects/3493ad30388949298437d5caa35d08d3/users/37aa7165bb5749d5bffcdb116bfde57a/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.443246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fd29c-e37c-43e5-919f-70f6f97d9552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3493ad30388949298437d5caa35d08d3, user_id=37aa7165bb5749d5bffcdb116bfde57a, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:01.448441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fd29c-e37c-43e5-919f-70f6f97d9552 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:01.476552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 806/1633] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:01 2022] PUT /identity/v3/projects/3493ad30388949298437d5caa35d08d3/users/37aa7165bb5749d5bffcdb116bfde57a/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:01.477691 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fd29c-e37c-43e5-919f-70f6f97d9552 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:01.564920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579a77-7268-4760-b295-78e87df14397 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:01.602068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fd29c-e37c-43e5-919f-70f6f97d9552 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:01.619001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c7ce5-fb2a-4ecf-b22d-f52c4693e40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:01.619676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c7ce5-fb2a-4ecf-b22d-f52c4693e40f admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.619955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c7ce5-fb2a-4ecf-b22d-f52c4693e40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.620319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c7ce5-fb2a-4ecf-b22d-f52c4693e40f admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.621532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c7ce5-fb2a-4ecf-b22d-f52c4693e40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:01.623298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c7ce5-fb2a-4ecf-b22d-f52c4693e40f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:01.642988 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d05954-5834-4563-b940-d757bcf984c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:01.643872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05954-5834-4563-b940-d757bcf984c0 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.644296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05954-5834-4563-b940-d757bcf984c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.645145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05954-5834-4563-b940-d757bcf984c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.652087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 807/1634] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:01.652087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d232-afbe-4945-b294-c63a5c3664b3 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.652087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d232-afbe-4945-b294-c63a5c3664b3 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.652087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d232-afbe-4945-b294-c63a5c3664b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.718118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-5125d232-afbe-4945-b294-c63a5c3664b3 None None] MFA Rules not processed for user `37aa7165bb5749d5bffcdb116bfde57a`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:01.721461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5125d232-afbe-4945-b294-c63a5c3664b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:01.788296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d05954-5834-4563-b940-d757bcf984c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:01.791606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d05954-5834-4563-b940-d757bcf984c0 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:01.809162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 828/1635] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:01.810697 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d05954-5834-4563-b940-d757bcf984c0 service nova] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:01.825793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d05954-5834-4563-b940-d757bcf984c0 service nova] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:01.831401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d9ff-d5e0-45b5-a712-f1c0fb220176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:01.832348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d9ff-d5e0-45b5-a712-f1c0fb220176 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.832922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d9ff-d5e0-45b5-a712-f1c0fb220176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.833452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d9ff-d5e0-45b5-a712-f1c0fb220176 admin admin] PATH_INFO: `/v3/projects/457ed96ab8764eef806ae1e7f079ea67/users/7e6cf22607134b8e8472cac3b92ff973/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.854028 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 808/1636] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:01.855927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337d9ff-d5e0-45b5-a712-f1c0fb220176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=457ed96ab8764eef806ae1e7f079ea67, user_id=7e6cf22607134b8e8472cac3b92ff973, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:01.859054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337d9ff-d5e0-45b5-a712-f1c0fb220176 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:01.863850 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125d232-afbe-4945-b294-c63a5c3664b3 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:01.885736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125d232-afbe-4945-b294-c63a5c3664b3 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:01.893993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:01.895417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.895979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.896663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] PATH_INFO: `/v3/users/fe607d136dc04cd7a5ab4fcbd310c547` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.899744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe607d136dc04cd7a5ab4fcbd310c547)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:01.910006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:01.935919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 829/1637] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:01 2022] PUT /identity/v3/projects/457ed96ab8764eef806ae1e7f079ea67/users/7e6cf22607134b8e8472cac3b92ff973/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:01.936786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d9ff-d5e0-45b5-a712-f1c0fb220176 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:02.043507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d9ff-d5e0-45b5-a712-f1c0fb220176 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:02.048808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e6631-a448-4d70-9b27-adbb0bd76615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:02.049441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6631-a448-4d70-9b27-adbb0bd76615 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:02.049867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6631-a448-4d70-9b27-adbb0bd76615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:02.049968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e6631-a448-4d70-9b27-adbb0bd76615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:02.114638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:02.134622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e6631-a448-4d70-9b27-adbb0bd76615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:02.138566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e6631-a448-4d70-9b27-adbb0bd76615 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:02.185574 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 830/1638] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:02.188382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e6631-a448-4d70-9b27-adbb0bd76615 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:02.248617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe607d136dc04cd7a5ab4fcbd310c547'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:02.250284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe607d136dc04cd7a5ab4fcbd310c547'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:02.275907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe607d136dc04cd7a5ab4fcbd310c547'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:02.279259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe607d136dc04cd7a5ab4fcbd310c547'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:02.327171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:02.421271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe607d136dc04cd7a5ab4fcbd310c547'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:02.423839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e6631-a448-4d70-9b27-adbb0bd76615 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:02.439901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5c961-4703-48ed-aedf-f8464bf5b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:02.440554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5c961-4703-48ed-aedf-f8464bf5b7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:02.442764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5c961-4703-48ed-aedf-f8464bf5b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:02.443041 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5c961-4703-48ed-aedf-f8464bf5b7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:02.444427 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5c961-4703-48ed-aedf-f8464bf5b7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:02.447934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5c961-4703-48ed-aedf-f8464bf5b7d0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:02.481528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 831/1639] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:02.483122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab283e7-9f57-411a-b25a-439f331357a4 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:02.483482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab283e7-9f57-411a-b25a-439f331357a4 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:02.483692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab283e7-9f57-411a-b25a-439f331357a4 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:02.490275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 809/1640] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:01 2022] DELETE /identity/v3/users/fe607d136dc04cd7a5ab4fcbd310c547 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:02.491294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:02.492003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 832/1641] 10.222.0.46 () {54 vars in 912 bytes} [Thu Aug 4 05:25:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:25:02.493543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9fe8-14c3-432d-a4d0-8ef7477cdf0d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:02.493843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9fe8-14c3-432d-a4d0-8ef7477cdf0d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:02.494100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9fe8-14c3-432d-a4d0-8ef7477cdf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:02.498481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:02.569222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-809e9fe8-14c3-432d-a4d0-8ef7477cdf0d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:02.570539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-809e9fe8-14c3-432d-a4d0-8ef7477cdf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:02.684917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c926d8-8129-4af4-8cb6-a609461f0740 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:02.691404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfd9e0-d559-4ef8-b5ac-70527cdac36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:02.692163 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd9e0-d559-4ef8-b5ac-70527cdac36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:02.692575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd9e0-d559-4ef8-b5ac-70527cdac36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:03.001145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd9e0-d559-4ef8-b5ac-70527cdac36b admin admin] PATH_INFO: `/v3/projects/457ed96ab8764eef806ae1e7f079ea67/users/7e6cf22607134b8e8472cac3b92ff973/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:03.001145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfd9e0-d559-4ef8-b5ac-70527cdac36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=457ed96ab8764eef806ae1e7f079ea67, user_id=7e6cf22607134b8e8472cac3b92ff973, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:03.001145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfd9e0-d559-4ef8-b5ac-70527cdac36b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:03.001145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 810/1642] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:02 2022] PUT /identity/v3/projects/457ed96ab8764eef806ae1e7f079ea67/users/7e6cf22607134b8e8472cac3b92ff973/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:03.001145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cd4ed-655c-4ee9-8eb7-6f4ff127a652 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:03.002783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cd4ed-655c-4ee9-8eb7-6f4ff127a652 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:03.002783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cd4ed-655c-4ee9-8eb7-6f4ff127a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:03.004688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 833/1643] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:03.004688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b890aa4-c308-44c2-8531-b7a4d40c9f46 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:03.004688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b890aa4-c308-44c2-8531-b7a4d40c9f46 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:03.004688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b890aa4-c308-44c2-8531-b7a4d40c9f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:03.006907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-2a4cd4ed-655c-4ee9-8eb7-6f4ff127a652 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:03.006907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2a4cd4ed-655c-4ee9-8eb7-6f4ff127a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:03.008542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9b890aa4-c308-44c2-8531-b7a4d40c9f46 None None] MFA Rules not processed for user `7e6cf22607134b8e8472cac3b92ff973`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:03.008542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9b890aa4-c308-44c2-8531-b7a4d40c9f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:03.050351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 834/1644] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:03.051568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b890aa4-c308-44c2-8531-b7a4d40c9f46 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:03.053183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9b890aa4-c308-44c2-8531-b7a4d40c9f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:03.121035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 811/1645] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:25:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:03.122293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cd4ed-655c-4ee9-8eb7-6f4ff127a652 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:03.122946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b890aa4-c308-44c2-8531-b7a4d40c9f46 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:03.127541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2a4cd4ed-655c-4ee9-8eb7-6f4ff127a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:03.127707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b8be9-4b00-4654-90f1-a14e7557ddb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:03.128357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b8be9-4b00-4654-90f1-a14e7557ddb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:03.128641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b8be9-4b00-4654-90f1-a14e7557ddb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:03.132318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b8be9-4b00-4654-90f1-a14e7557ddb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:03.145611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:03.255005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:03.276140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b8be9-4b00-4654-90f1-a14e7557ddb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:03.278300 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b8be9-4b00-4654-90f1-a14e7557ddb4 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:03.303111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 835/1646] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:03.304255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b8be9-4b00-4654-90f1-a14e7557ddb4 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:03.307290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-388b8be9-4b00-4654-90f1-a14e7557ddb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:03.309989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cd4ed-655c-4ee9-8eb7-6f4ff127a652 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:03.331303 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f719c2-a541-42b4-af57-bd3747677690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:03.332077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f719c2-a541-42b4-af57-bd3747677690 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:03.332427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f719c2-a541-42b4-af57-bd3747677690 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:03.332773 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f719c2-a541-42b4-af57-bd3747677690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:03.333423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b8be9-4b00-4654-90f1-a14e7557ddb4 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:03.334856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c3f719c2-a541-42b4-af57-bd3747677690 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:03.345499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb500b-ed29-43d8-81ee-2c423e17cc71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:03.346238 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb500b-ed29-43d8-81ee-2c423e17cc71 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:03.346610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb500b-ed29-43d8-81ee-2c423e17cc71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:03.346976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb500b-ed29-43d8-81ee-2c423e17cc71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:03.374812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb500b-ed29-43d8-81ee-2c423e17cc71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:03.376461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb500b-ed29-43d8-81ee-2c423e17cc71 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:03.397685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 836/1647] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:03.485571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f719c2-a541-42b4-af57-bd3747677690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:03.487112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f719c2-a541-42b4-af57-bd3747677690 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:03.513057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 812/1648] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:03.603285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb500b-ed29-43d8-81ee-2c423e17cc71 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:03.616246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb500b-ed29-43d8-81ee-2c423e17cc71 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:03.629000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea7e52-b09b-4a55-b15f-6fa57a90dfe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:03.629704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea7e52-b09b-4a55-b15f-6fa57a90dfe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:03.629987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea7e52-b09b-4a55-b15f-6fa57a90dfe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:03.630345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea7e52-b09b-4a55-b15f-6fa57a90dfe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:03.654711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea7e52-b09b-4a55-b15f-6fa57a90dfe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:03.656735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea7e52-b09b-4a55-b15f-6fa57a90dfe5 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:03.680853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 837/1649] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:04.294708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:04.630948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f719c2-a541-42b4-af57-bd3747677690 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:04.638160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c3f719c2-a541-42b4-af57-bd3747677690 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:04.685710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f719c2-a541-42b4-af57-bd3747677690 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:04.723408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:04.724678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:04.726343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:04.726343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] PATH_INFO: `/v3/projects/37fc18d6212f4e1d91eb2db38659f154` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:04.728683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37fc18d6212f4e1d91eb2db38659f154)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:04.730655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: WARNING py.warnings [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:25:04.730655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: warnings.warn(msg) Aug 04 05:25:04.730655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: Aug 04 05:25:04.733457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:05.071155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea7e52-b09b-4a55-b15f-6fa57a90dfe5 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:05.080679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37fc18d6212f4e1d91eb2db38659f154', 'request_id': 'req-83db6737-6430-45e8-9092-d9377b1fe992'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:05.084814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea7e52-b09b-4a55-b15f-6fa57a90dfe5 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:05.186727 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37fc18d6212f4e1d91eb2db38659f154', 'request_id': 'req-83db6737-6430-45e8-9092-d9377b1fe992'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:05.283329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0017fb-a135-48d8-927b-9137a554152c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:05.283985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0017fb-a135-48d8-927b-9137a554152c service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:05.284267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0017fb-a135-48d8-927b-9137a554152c service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:05.284547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0017fb-a135-48d8-927b-9137a554152c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:05.296409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bd0017fb-a135-48d8-927b-9137a554152c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:05.399020 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0017fb-a135-48d8-927b-9137a554152c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:05.400912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0017fb-a135-48d8-927b-9137a554152c service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:05.415777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 838/1650] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:25:05.483296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad4fc9-e879-4623-aac8-421215c10779 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:05.484328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad4fc9-e879-4623-aac8-421215c10779 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:05.485128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad4fc9-e879-4623-aac8-421215c10779 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:05.487745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 839/1651] 10.222.0.46 () {54 vars in 962 bytes} [Thu Aug 4 05:25:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:25:05.528301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf2ff-7ae7-4824-b2b0-5105213551c0 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:05.528301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf2ff-7ae7-4824-b2b0-5105213551c0 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:05.528301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf2ff-7ae7-4824-b2b0-5105213551c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:05.560403 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-807cf2ff-7ae7-4824-b2b0-5105213551c0 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:05.562591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-807cf2ff-7ae7-4824-b2b0-5105213551c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:05.704811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37fc18d6212f4e1d91eb2db38659f154', 'request_id': 'req-83db6737-6430-45e8-9092-d9377b1fe992'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:05.718422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:05.723877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] The token cache is being invalidate because project 37fc18d6212f4e1d91eb2db38659f154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:05.724427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:05.727324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:05.732222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 813/1652] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:04 2022] DELETE /identity/v3/projects/37fc18d6212f4e1d91eb2db38659f154 => generated 0 bytes in 1103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:05.742199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:05.743038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:05.764132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 840/1653] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Aug 4 05:25:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:05.770507 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:05.778044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3426-e6f6-4069-8099-d2150cc105e1 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:05.778501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3426-e6f6-4069-8099-d2150cc105e1 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:05.778889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3426-e6f6-4069-8099-d2150cc105e1 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:05.781158 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 841/1654] 10.222.0.46 () {54 vars in 912 bytes} [Thu Aug 4 05:25:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:25:05.789749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34045-235d-4749-9285-523344ce3541 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:05.792387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34045-235d-4749-9285-523344ce3541 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:05.792624 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34045-235d-4749-9285-523344ce3541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:05.868021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-61e34045-235d-4749-9285-523344ce3541 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:05.869326 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-61e34045-235d-4749-9285-523344ce3541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:05.924657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 842/1655] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:25:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:06.000827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db6737-6430-45e8-9092-d9377b1fe992 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:06.018097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:06.018969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:06.023458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:06.023870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] PATH_INFO: `/v3/users/ed55efd8bcf34aa29d54ec62cc24de80` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:06.029432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed55efd8bcf34aa29d54ec62cc24de80)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:06.036547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:06.327145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e34045-235d-4749-9285-523344ce3541 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:06.330455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-61e34045-235d-4749-9285-523344ce3541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:06.381563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e34045-235d-4749-9285-523344ce3541 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:06.394135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c8ff9-7054-4e33-ba93-3b99856748b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:06.396328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c8ff9-7054-4e33-ba93-3b99856748b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:06.398235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c8ff9-7054-4e33-ba93-3b99856748b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:06.401255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed55efd8bcf34aa29d54ec62cc24de80'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:06.401972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c8ff9-7054-4e33-ba93-3b99856748b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:06.424588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed55efd8bcf34aa29d54ec62cc24de80'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:06.441066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed55efd8bcf34aa29d54ec62cc24de80'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:06.444118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed55efd8bcf34aa29d54ec62cc24de80'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:06.462347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c8ff9-7054-4e33-ba93-3b99856748b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:06.465075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c8ff9-7054-4e33-ba93-3b99856748b6 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:06.504279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 843/1656] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:06.562615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed55efd8bcf34aa29d54ec62cc24de80'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:06.640918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 814/1657] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:05 2022] DELETE /identity/v3/users/ed55efd8bcf34aa29d54ec62cc24de80 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:07.968902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9f14a-93ab-4b3e-988b-0453986a65c5 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:07.968902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9f14a-93ab-4b3e-988b-0453986a65c5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:07.970555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9f14a-93ab-4b3e-988b-0453986a65c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:08.123145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-1de9f14a-93ab-4b3e-988b-0453986a65c5 None None] MFA Rules not processed for user `9cb49b631c234f9a9fd47049b9b2e097`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:08.130577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1de9f14a-93ab-4b3e-988b-0453986a65c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:08.389975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 844/1658] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:08.407204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:08.408806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:08.531247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:08.586395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d61cd-893d-4063-a470-2984ce69c85c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:08.601725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7d2c3-641d-474e-9701-890303369b4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:08.602799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7d2c3-641d-474e-9701-890303369b4c service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:08.603270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7d2c3-641d-474e-9701-890303369b4c service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:08.603728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7d2c3-641d-474e-9701-890303369b4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:08.623723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7d2c3-641d-474e-9701-890303369b4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:08.629834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7d2c3-641d-474e-9701-890303369b4c service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:08.652927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 815/1659] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:08.660262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9f14a-93ab-4b3e-988b-0453986a65c5 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:08.663676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1de9f14a-93ab-4b3e-988b-0453986a65c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:08.846692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9f14a-93ab-4b3e-988b-0453986a65c5 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:08.854037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:08.855469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:08.856019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:08.856453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] PATH_INFO: `/v3/projects/dd0be234a5924389970aaf99c3877a75` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:08.859550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0be234a5924389970aaf99c3877a75)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:08.864315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:09.455940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0be234a5924389970aaf99c3877a75', 'request_id': 'req-708dc7a9-82c8-4eb9-b007-eb4f90b53883'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:09.469714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0be234a5924389970aaf99c3877a75', 'request_id': 'req-708dc7a9-82c8-4eb9-b007-eb4f90b53883'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:09.474496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:09.572862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0be234a5924389970aaf99c3877a75', 'request_id': 'req-708dc7a9-82c8-4eb9-b007-eb4f90b53883'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:09.591048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] The token cache is being invalidate because project dd0be234a5924389970aaf99c3877a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:09.599411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:09.603172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-708dc7a9-82c8-4eb9-b007-eb4f90b53883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:09.606696 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 845/1660] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:08 2022] DELETE /identity/v3/projects/dd0be234a5924389970aaf99c3877a75 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:09.611398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c8c20-9480-4a05-82d6-bbbb69963bc6 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:09.618655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c8c20-9480-4a05-82d6-bbbb69963bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:09.618655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c8c20-9480-4a05-82d6-bbbb69963bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:09.639778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-1c6c8c20-9480-4a05-82d6-bbbb69963bc6 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:09.653046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1c6c8c20-9480-4a05-82d6-bbbb69963bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:09.780735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 816/1661] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:09.794463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eca0e-68f3-42f2-9d66-be468d580e94 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:09.801873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eca0e-68f3-42f2-9d66-be468d580e94 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:09.801873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eca0e-68f3-42f2-9d66-be468d580e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:09.835962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a33eca0e-68f3-42f2-9d66-be468d580e94 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:09.840762 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a33eca0e-68f3-42f2-9d66-be468d580e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:09.862297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 846/1662] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:09.868232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c8c20-9480-4a05-82d6-bbbb69963bc6 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:09.884733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c8c20-9480-4a05-82d6-bbbb69963bc6 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:09.899285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c780e-4afc-4849-a4ea-e24c132a4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:09.899285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c780e-4afc-4849-a4ea-e24c132a4f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:09.899285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c780e-4afc-4849-a4ea-e24c132a4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:09.899285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c780e-4afc-4849-a4ea-e24c132a4f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:09.904506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c780e-4afc-4849-a4ea-e24c132a4f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:09.905300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c780e-4afc-4849-a4ea-e24c132a4f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:09.907208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c780e-4afc-4849-a4ea-e24c132a4f8e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:09.955954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33eca0e-68f3-42f2-9d66-be468d580e94 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:09.956862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 817/1663] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:25:09.975656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33eca0e-68f3-42f2-9d66-be468d580e94 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:09.989142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6f056-6fce-43c8-8516-66e16f01bf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:09.989142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6f056-6fce-43c8-8516-66e16f01bf8e admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:09.989142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6f056-6fce-43c8-8516-66e16f01bf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:09.989142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6f056-6fce-43c8-8516-66e16f01bf8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:09.989391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6f056-6fce-43c8-8516-66e16f01bf8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:09.989391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6f056-6fce-43c8-8516-66e16f01bf8e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:10.202226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 847/1664] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:09 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:25:10.209341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c780e-4afc-4849-a4ea-e24c132a4f8e admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:10.233020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c780e-4afc-4849-a4ea-e24c132a4f8e admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:10.383298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71106b4c-625a-4cd8-90a9-f320ad2e4177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:10.384156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71106b4c-625a-4cd8-90a9-f320ad2e4177 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:10.384536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71106b4c-625a-4cd8-90a9-f320ad2e4177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:10.384935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71106b4c-625a-4cd8-90a9-f320ad2e4177 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:10.385837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71106b4c-625a-4cd8-90a9-f320ad2e4177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:10.393689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71106b4c-625a-4cd8-90a9-f320ad2e4177 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:10.558491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 818/1665] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:10 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:10.558780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6f056-6fce-43c8-8516-66e16f01bf8e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:10.599546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6f056-6fce-43c8-8516-66e16f01bf8e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:10.618677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16ff4-735f-46f9-84d2-d4a4a760a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:10.619557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16ff4-735f-46f9-84d2-d4a4a760a8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:10.619879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16ff4-735f-46f9-84d2-d4a4a760a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:10.620211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16ff4-735f-46f9-84d2-d4a4a760a8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:10.621493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d16ff4-735f-46f9-84d2-d4a4a760a8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:10.625270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d16ff4-735f-46f9-84d2-d4a4a760a8d4 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:10.666341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 848/1666] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:10.668792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71106b4c-625a-4cd8-90a9-f320ad2e4177 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:10.684520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71106b4c-625a-4cd8-90a9-f320ad2e4177 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:10.704545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653b46e-3bdd-40ae-b8f0-e50a0fb59cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:10.705913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653b46e-3bdd-40ae-b8f0-e50a0fb59cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:10.706201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653b46e-3bdd-40ae-b8f0-e50a0fb59cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:10.706740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653b46e-3bdd-40ae-b8f0-e50a0fb59cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:10.707496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653b46e-3bdd-40ae-b8f0-e50a0fb59cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:10.717878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653b46e-3bdd-40ae-b8f0-e50a0fb59cf7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:10.753951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16ff4-735f-46f9-84d2-d4a4a760a8d4 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:10.755944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 819/1667] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:10.767938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16ff4-735f-46f9-84d2-d4a4a760a8d4 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:10.780107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ffe4b-0784-4e1a-a7d0-615cd7840100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:10.781565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ffe4b-0784-4e1a-a7d0-615cd7840100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:10.782864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ffe4b-0784-4e1a-a7d0-615cd7840100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:10.783612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ffe4b-0784-4e1a-a7d0-615cd7840100 admin admin] PATH_INFO: `/v3/projects/ae24a99d793d464183d8c7657f334029/users/444a2fdad38a4c6abac8dacc0729820c/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:10.843611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ffe4b-0784-4e1a-a7d0-615cd7840100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae24a99d793d464183d8c7657f334029, user_id=444a2fdad38a4c6abac8dacc0729820c, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:10.849557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ffe4b-0784-4e1a-a7d0-615cd7840100 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:11.027390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 849/1668] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:10 2022] PUT /identity/v3/projects/ae24a99d793d464183d8c7657f334029/users/444a2fdad38a4c6abac8dacc0729820c/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:11.027580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16bc6e-f1e0-4afb-8114-e8d3d1066cce None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:11.027724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16bc6e-f1e0-4afb-8114-e8d3d1066cce None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:11.028012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16bc6e-f1e0-4afb-8114-e8d3d1066cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:11.084326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-0b16bc6e-f1e0-4afb-8114-e8d3d1066cce None None] MFA Rules not processed for user `444a2fdad38a4c6abac8dacc0729820c`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:11.085441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0b16bc6e-f1e0-4afb-8114-e8d3d1066cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:11.213177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 820/1669] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:11.217382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ffe4b-0784-4e1a-a7d0-615cd7840100 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:11.373328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ffe4b-0784-4e1a-a7d0-615cd7840100 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:11.391009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b5d3c-7a93-4ef1-8ce7-d414f00773c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:11.398158 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b5d3c-7a93-4ef1-8ce7-d414f00773c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:11.398625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b5d3c-7a93-4ef1-8ce7-d414f00773c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:11.398914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b5d3c-7a93-4ef1-8ce7-d414f00773c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:11.399810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b5d3c-7a93-4ef1-8ce7-d414f00773c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:11.406588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b5d3c-7a93-4ef1-8ce7-d414f00773c5 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:11.567883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 850/1670] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:11 2022] POST /identity/v3/projects => generated 377 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:11.572320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16bc6e-f1e0-4afb-8114-e8d3d1066cce None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:11.592984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16bc6e-f1e0-4afb-8114-e8d3d1066cce None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:11.705620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daa948-dd9b-49ad-972a-4d5c1a7ff6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:11.706996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daa948-dd9b-49ad-972a-4d5c1a7ff6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:11.707556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daa948-dd9b-49ad-972a-4d5c1a7ff6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:11.707975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daa948-dd9b-49ad-972a-4d5c1a7ff6e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:11.708836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daa948-dd9b-49ad-972a-4d5c1a7ff6e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:11.711574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daa948-dd9b-49ad-972a-4d5c1a7ff6e8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:11.804415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 821/1671] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:11 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:11.808181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b5d3c-7a93-4ef1-8ce7-d414f00773c5 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:11.848967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b5d3c-7a93-4ef1-8ce7-d414f00773c5 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:11.862743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f7c2b-a0c7-4de9-a847-5261659cbad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:11.863518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f7c2b-a0c7-4de9-a847-5261659cbad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:11.865086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f7c2b-a0c7-4de9-a847-5261659cbad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:11.867551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f7c2b-a0c7-4de9-a847-5261659cbad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:11.868296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f7c2b-a0c7-4de9-a847-5261659cbad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:11.877082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f7c2b-a0c7-4de9-a847-5261659cbad8 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:11.906611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 851/1672] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:11.909748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daa948-dd9b-49ad-972a-4d5c1a7ff6e8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:11.923875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:11.929908 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daa948-dd9b-49ad-972a-4d5c1a7ff6e8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:11.944487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e59f56-74d7-4cc4-8f37-2e59a22f2518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:11.950747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59f56-74d7-4cc4-8f37-2e59a22f2518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:11.951371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59f56-74d7-4cc4-8f37-2e59a22f2518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:11.951981 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59f56-74d7-4cc4-8f37-2e59a22f2518 admin admin] PATH_INFO: `/v3/projects/f5659f9473964cc2af4362b091b8adde/users/f4880c9970e14533af8f4cc1bca82c52/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:11.982532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e59f56-74d7-4cc4-8f37-2e59a22f2518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5659f9473964cc2af4362b091b8adde, user_id=f4880c9970e14533af8f4cc1bca82c52, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:11.985598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e59f56-74d7-4cc4-8f37-2e59a22f2518 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:12.050279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 822/1673] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:11 2022] PUT /identity/v3/projects/f5659f9473964cc2af4362b091b8adde/users/f4880c9970e14533af8f4cc1bca82c52/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:12.054072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f7c2b-a0c7-4de9-a847-5261659cbad8 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:12.079549 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f7c2b-a0c7-4de9-a847-5261659cbad8 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:12.265167 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8fbac-fdb8-4bf6-bb9c-99fa7c0fe416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:12.265806 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8fbac-fdb8-4bf6-bb9c-99fa7c0fe416 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:12.266084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8fbac-fdb8-4bf6-bb9c-99fa7c0fe416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:12.266442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8fbac-fdb8-4bf6-bb9c-99fa7c0fe416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:12.281513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8fbac-fdb8-4bf6-bb9c-99fa7c0fe416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:12.283259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8fbac-fdb8-4bf6-bb9c-99fa7c0fe416 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:12.295274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 852/1674] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:12.299529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e59f56-74d7-4cc4-8f37-2e59a22f2518 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:12.314292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e59f56-74d7-4cc4-8f37-2e59a22f2518 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:12.319885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dea2b-c48c-4a2b-b170-fb528b8ecbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:12.320952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dea2b-c48c-4a2b-b170-fb528b8ecbfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:12.322183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dea2b-c48c-4a2b-b170-fb528b8ecbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:12.322706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dea2b-c48c-4a2b-b170-fb528b8ecbfc admin admin] PATH_INFO: `/v3/projects/f5659f9473964cc2af4362b091b8adde/users/f4880c9970e14533af8f4cc1bca82c52/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:12.328222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:12.341681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dea2b-c48c-4a2b-b170-fb528b8ecbfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5659f9473964cc2af4362b091b8adde, user_id=f4880c9970e14533af8f4cc1bca82c52, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:12.343941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dea2b-c48c-4a2b-b170-fb528b8ecbfc admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:12.373403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 823/1675] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:12 2022] PUT /identity/v3/projects/f5659f9473964cc2af4362b091b8adde/users/f4880c9970e14533af8f4cc1bca82c52/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:12.374428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839aaf6-f0ca-4925-8dfc-9b5a84e835a7 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:12.374720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839aaf6-f0ca-4925-8dfc-9b5a84e835a7 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:12.375002 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839aaf6-f0ca-4925-8dfc-9b5a84e835a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:12.448949 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-5839aaf6-f0ca-4925-8dfc-9b5a84e835a7 None None] MFA Rules not processed for user `f4880c9970e14533af8f4cc1bca82c52`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:12.452499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5839aaf6-f0ca-4925-8dfc-9b5a84e835a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:12.723612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 853/1676] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:12.917862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dea2b-c48c-4a2b-b170-fb528b8ecbfc admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:12.920812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-974dea2b-c48c-4a2b-b170-fb528b8ecbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:12.996697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dea2b-c48c-4a2b-b170-fb528b8ecbfc admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:13.000848 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7634d81-22f7-4c78-8222-1396e5375d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:13.001582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634d81-22f7-4c78-8222-1396e5375d3e service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:13.002107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634d81-22f7-4c78-8222-1396e5375d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:13.002602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634d81-22f7-4c78-8222-1396e5375d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:13.173888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7634d81-22f7-4c78-8222-1396e5375d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:13.177318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7634d81-22f7-4c78-8222-1396e5375d3e service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:13.213181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 824/1677] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:13.749476 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9a18-8755-434b-8ae0-12281b35f76b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:13.749948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9a18-8755-434b-8ae0-12281b35f76b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:13.750045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9a18-8755-434b-8ae0-12281b35f76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:13.806240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-d79d9a18-8755-434b-8ae0-12281b35f76b None None] MFA Rules not processed for user `ab8f887f5689419e9e31a0ba43f76ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:13.808556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:13.809425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d79d9a18-8755-434b-8ae0-12281b35f76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:14.012728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 854/1678] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:14.022763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0af594-5242-4f6c-98c4-e976cacbc9d2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:14.024132 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0af594-5242-4f6c-98c4-e976cacbc9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:14.030446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0af594-5242-4f6c-98c4-e976cacbc9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:14.069050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8c0af594-5242-4f6c-98c4-e976cacbc9d2 None None] MFA Rules not processed for user `ab8f887f5689419e9e31a0ba43f76ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:14.070541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8c0af594-5242-4f6c-98c4-e976cacbc9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:14.081079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 825/1679] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:14.107406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9a18-8755-434b-8ae0-12281b35f76b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:14.113924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d79d9a18-8755-434b-8ae0-12281b35f76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:14.261197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9a18-8755-434b-8ae0-12281b35f76b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:14.270817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d421d2-9e59-4bf7-a5fc-a758f0e67a6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:14.273566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d421d2-9e59-4bf7-a5fc-a758f0e67a6c service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:14.273807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d421d2-9e59-4bf7-a5fc-a758f0e67a6c service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:14.274891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d421d2-9e59-4bf7-a5fc-a758f0e67a6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:14.288050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d421d2-9e59-4bf7-a5fc-a758f0e67a6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:14.290204 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d421d2-9e59-4bf7-a5fc-a758f0e67a6c service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:14.324856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 855/1680] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:14.623194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ce70-b0f5-4c87-a8ca-48885334acba None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:14.623194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ce70-b0f5-4c87-a8ca-48885334acba None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:14.623725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ce70-b0f5-4c87-a8ca-48885334acba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:14.712682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-5331ce70-b0f5-4c87-a8ca-48885334acba None None] MFA Rules not processed for user `e916e4e0fb7140b0912e9233898a0016`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:14.714503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5331ce70-b0f5-4c87-a8ca-48885334acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:14.741457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0092e-dec4-41bf-9a98-8328eff06a73 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:14.741764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0092e-dec4-41bf-9a98-8328eff06a73 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:14.747495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0092e-dec4-41bf-9a98-8328eff06a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:14.773290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ccd0092e-dec4-41bf-9a98-8328eff06a73 None None] MFA Rules not processed for user `9cb49b631c234f9a9fd47049b9b2e097`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:14.774544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ccd0092e-dec4-41bf-9a98-8328eff06a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:14.911892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 856/1681] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:14.939084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 826/1682] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:14.952217 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de14cb-9525-480b-ac1f-94c7ca64f9fe None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:14.952937 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de14cb-9525-480b-ac1f-94c7ca64f9fe None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:14.952937 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de14cb-9525-480b-ac1f-94c7ca64f9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:14.991416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b2de14cb-9525-480b-ac1f-94c7ca64f9fe None None] MFA Rules not processed for user `e916e4e0fb7140b0912e9233898a0016`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:14.992644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b2de14cb-9525-480b-ac1f-94c7ca64f9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:15.007165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:15.014734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 857/1683] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:15.065109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff39b7-aaea-48b4-9a33-6d171c02631f None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:15.070253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff39b7-aaea-48b4-9a33-6d171c02631f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:15.070253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff39b7-aaea-48b4-9a33-6d171c02631f None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:15.070253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 827/1684] 10.222.0.46 () {54 vars in 912 bytes} [Thu Aug 4 05:25:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:25:15.073052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c27d40-acbb-4d2a-ab66-2523e8047f40 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:15.073390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c27d40-acbb-4d2a-ab66-2523e8047f40 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:15.073775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c27d40-acbb-4d2a-ab66-2523e8047f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:15.169646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-73c27d40-acbb-4d2a-ab66-2523e8047f40 None None] MFA Rules not processed for user `4213a478acfe4cc88df41b3da2d581ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:15.172056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-73c27d40-acbb-4d2a-ab66-2523e8047f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:15.299338 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 858/1685] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:25:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:15.335189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff39b7-aaea-48b4-9a33-6d171c02631f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:15.337899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b6ff39b7-aaea-48b4-9a33-6d171c02631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:15.361017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff39b7-aaea-48b4-9a33-6d171c02631f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:15.378333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe28fb-29b6-4bda-9681-42f48fa3c8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:15.379476 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe28fb-29b6-4bda-9681-42f48fa3c8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:15.381236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe28fb-29b6-4bda-9681-42f48fa3c8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:15.381791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe28fb-29b6-4bda-9681-42f48fa3c8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:15.406385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe28fb-29b6-4bda-9681-42f48fa3c8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:15.408264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe28fb-29b6-4bda-9681-42f48fa3c8b1 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:15.436408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 828/1686] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:16.046821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bb162-95c5-4c7a-b320-1423f1d8a19f None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:16.048443 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bb162-95c5-4c7a-b320-1423f1d8a19f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:16.049281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bb162-95c5-4c7a-b320-1423f1d8a19f None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:16.053175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 859/1687] 10.222.0.46 () {54 vars in 912 bytes} [Thu Aug 4 05:25:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:25:16.064681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa612248-8a13-4129-8f74-28a26c48f97f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:16.065368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa612248-8a13-4129-8f74-28a26c48f97f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:16.065950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa612248-8a13-4129-8f74-28a26c48f97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:16.200854 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-fa612248-8a13-4129-8f74-28a26c48f97f None None] MFA Rules not processed for user `4213a478acfe4cc88df41b3da2d581ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:16.202174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-fa612248-8a13-4129-8f74-28a26c48f97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:16.237453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 829/1688] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:25:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:16.254917 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bb162-95c5-4c7a-b320-1423f1d8a19f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:16.286919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bb162-95c5-4c7a-b320-1423f1d8a19f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:16.293687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e979da-8a5d-4583-880f-8c4a215cc37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:16.295446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e979da-8a5d-4583-880f-8c4a215cc37e service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:16.295912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e979da-8a5d-4583-880f-8c4a215cc37e service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:16.296372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e979da-8a5d-4583-880f-8c4a215cc37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:16.327406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e979da-8a5d-4583-880f-8c4a215cc37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:16.330019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e979da-8a5d-4583-880f-8c4a215cc37e service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:16.344407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 860/1689] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:25:16.503678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa612248-8a13-4129-8f74-28a26c48f97f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:16.531740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa612248-8a13-4129-8f74-28a26c48f97f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:16.544971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa2c86-5510-4f4e-9a9e-2701ea8cd585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:16.545864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2c86-5510-4f4e-9a9e-2701ea8cd585 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:16.546228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2c86-5510-4f4e-9a9e-2701ea8cd585 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:16.547297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2c86-5510-4f4e-9a9e-2701ea8cd585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:16.576547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa2c86-5510-4f4e-9a9e-2701ea8cd585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:16.578219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa2c86-5510-4f4e-9a9e-2701ea8cd585 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:16.617194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed7561-0208-4705-99c1-0f84d5306e07 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:16.618059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed7561-0208-4705-99c1-0f84d5306e07 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:16.618481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed7561-0208-4705-99c1-0f84d5306e07 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:16.620975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 861/1690] 10.222.0.46 () {54 vars in 961 bytes} [Thu Aug 4 05:25:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:25:16.627190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787ee4c-575d-4966-bf7c-49d867639ac9 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:16.627710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787ee4c-575d-4966-bf7c-49d867639ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:16.628393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787ee4c-575d-4966-bf7c-49d867639ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:16.632753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 830/1691] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:16.655506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f787ee4c-575d-4966-bf7c-49d867639ac9 None None] MFA Rules not processed for user `448d43be14a74865a1e0d09e76c7e248`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:16.656805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f787ee4c-575d-4966-bf7c-49d867639ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:16.833110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 862/1692] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Aug 4 05:25:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 04 05:25:16.834075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa2c86-5510-4f4e-9a9e-2701ea8cd585 service nova] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:16.858985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa2c86-5510-4f4e-9a9e-2701ea8cd585 service nova] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:16.867067 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71681f-924a-4a3e-a9a9-19b6c5c85576 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:16.868065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71681f-924a-4a3e-a9a9-19b6c5c85576 service placement] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:16.868441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71681f-924a-4a3e-a9a9-19b6c5c85576 service placement] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:16.868833 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71681f-924a-4a3e-a9a9-19b6c5c85576 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:16.873420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1c71681f-924a-4a3e-a9a9-19b6c5c85576 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:16.899268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71681f-924a-4a3e-a9a9-19b6c5c85576 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:16.903605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71681f-924a-4a3e-a9a9-19b6c5c85576 service placement] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:16.947812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 831/1693] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:18.407363 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8e2ac-20b3-441d-9cbc-5c165f1e37b3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:18.408420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8e2ac-20b3-441d-9cbc-5c165f1e37b3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:18.408876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8e2ac-20b3-441d-9cbc-5c165f1e37b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:18.437185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f4d8e2ac-20b3-441d-9cbc-5c165f1e37b3 None None] MFA Rules not processed for user `ab8f887f5689419e9e31a0ba43f76ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:18.438809 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f4d8e2ac-20b3-441d-9cbc-5c165f1e37b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:18.467674 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 863/1694] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:21.879374 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71681f-924a-4a3e-a9a9-19b6c5c85576 service placement] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:21.895545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71681f-924a-4a3e-a9a9-19b6c5c85576 service placement] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:21.902443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971346-5e29-479d-b1ae-ece115c74c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:21.903143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971346-5e29-479d-b1ae-ece115c74c69 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:21.903430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971346-5e29-479d-b1ae-ece115c74c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:21.903707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971346-5e29-479d-b1ae-ece115c74c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:21.914698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971346-5e29-479d-b1ae-ece115c74c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:21.916189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971346-5e29-479d-b1ae-ece115c74c69 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:21.934518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 832/1695] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:23.820033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8e2ac-20b3-441d-9cbc-5c165f1e37b3 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:23.822616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f4d8e2ac-20b3-441d-9cbc-5c165f1e37b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:23.833799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:23.984530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8e2ac-20b3-441d-9cbc-5c165f1e37b3 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:23.990927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:23.993435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:23.993435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:23.993435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] PATH_INFO: `/v3/users/a4c17d030bc245a18605be1d10f12419` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:23.994256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c17d030bc245a18605be1d10f12419)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:23.996008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: WARNING py.warnings [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:25:23.996008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: warnings.warn(msg) Aug 04 05:25:23.996008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: Aug 04 05:25:23.997245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:24.320580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c17d030bc245a18605be1d10f12419'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:24.321438 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c17d030bc245a18605be1d10f12419'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:24.336486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c17d030bc245a18605be1d10f12419'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:24.367040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c17d030bc245a18605be1d10f12419'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:24.477197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c17d030bc245a18605be1d10f12419'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:24.491842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 864/1696] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:23 2022] DELETE /identity/v3/users/a4c17d030bc245a18605be1d10f12419 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:24.497220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ec16-9267-43e8-9a3c-c2eb9f4b1387 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:24.498193 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ec16-9267-43e8-9a3c-c2eb9f4b1387 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:24.498950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ec16-9267-43e8-9a3c-c2eb9f4b1387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:24.535690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-4005ec16-9267-43e8-9a3c-c2eb9f4b1387 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:24.536936 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4005ec16-9267-43e8-9a3c-c2eb9f4b1387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:24.601102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:24.617027 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 833/1697] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:24.652895 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:24.655244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:24.757100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa0ce-9c2f-4a51-865e-26cea6f57cd6 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:24.762351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204a83b-d831-46e1-b913-533690132ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:24.762978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204a83b-d831-46e1-b913-533690132ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:24.763262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204a83b-d831-46e1-b913-533690132ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:24.763537 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204a83b-d831-46e1-b913-533690132ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:24.773719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204a83b-d831-46e1-b913-533690132ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:24.779704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204a83b-d831-46e1-b913-533690132ef5 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:24.794291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 865/1698] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:25.374877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005ec16-9267-43e8-9a3c-c2eb9f4b1387 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:25.378159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4005ec16-9267-43e8-9a3c-c2eb9f4b1387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:25.392488 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005ec16-9267-43e8-9a3c-c2eb9f4b1387 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:25.397956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:25.399964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:25.399964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:25.399964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] PATH_INFO: `/v3/projects/820b25adb06d4245b9782065161f70b3` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:25.401874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=820b25adb06d4245b9782065161f70b3)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:25.404091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:25.523146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820b25adb06d4245b9782065161f70b3', 'request_id': 'req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:25.530687 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820b25adb06d4245b9782065161f70b3', 'request_id': 'req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:25.589929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820b25adb06d4245b9782065161f70b3', 'request_id': 'req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:25.604363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] The token cache is being invalidate because project 820b25adb06d4245b9782065161f70b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:25.605481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:25.606155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5d5941c3-474c-4e05-9e2d-31c342ffd2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:25.608737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 834/1699] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:25 2022] DELETE /identity/v3/projects/820b25adb06d4245b9782065161f70b3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:25.616201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f1cd-b8eb-499a-987e-2278c2279912 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:25.617169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f1cd-b8eb-499a-987e-2278c2279912 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:25.617451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f1cd-b8eb-499a-987e-2278c2279912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:25.639115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3586f1cd-b8eb-499a-987e-2278c2279912 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:25.640336 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3586f1cd-b8eb-499a-987e-2278c2279912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:25.664168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:25.710518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 866/1700] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:25.719216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393edd07-d1b3-467a-94eb-f7f29ea25b8a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:25.719559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393edd07-d1b3-467a-94eb-f7f29ea25b8a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:25.719911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393edd07-d1b3-467a-94eb-f7f29ea25b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:25.743761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-393edd07-d1b3-467a-94eb-f7f29ea25b8a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:25.745163 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-393edd07-d1b3-467a-94eb-f7f29ea25b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:25.756294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 835/1701] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:25.761454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586f1cd-b8eb-499a-987e-2278c2279912 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:25.775652 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586f1cd-b8eb-499a-987e-2278c2279912 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:25.783320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de1df-e773-4b9e-8de0-8a51af08100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:25.783320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de1df-e773-4b9e-8de0-8a51af08100a admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:25.783320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de1df-e773-4b9e-8de0-8a51af08100a admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:25.783320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de1df-e773-4b9e-8de0-8a51af08100a admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:25.783599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de1df-e773-4b9e-8de0-8a51af08100a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:25.783599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de1df-e773-4b9e-8de0-8a51af08100a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:25.785025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de1df-e773-4b9e-8de0-8a51af08100a admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:25.798436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 867/1702] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:25:25.801958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393edd07-d1b3-467a-94eb-f7f29ea25b8a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:25.811750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393edd07-d1b3-467a-94eb-f7f29ea25b8a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:25.816566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340759c8-e65e-4cf9-a5f5-ddd74882253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:25.817182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340759c8-e65e-4cf9-a5f5-ddd74882253d admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:25.817461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340759c8-e65e-4cf9-a5f5-ddd74882253d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:25.817742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340759c8-e65e-4cf9-a5f5-ddd74882253d admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:25.818470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340759c8-e65e-4cf9-a5f5-ddd74882253d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:25.829292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340759c8-e65e-4cf9-a5f5-ddd74882253d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:25.940154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 836/1703] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:25 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:25.944543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de1df-e773-4b9e-8de0-8a51af08100a admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:25.956560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de1df-e773-4b9e-8de0-8a51af08100a admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:26.062763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d54c9-4615-49c9-a03f-7d077d747e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:26.063606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d54c9-4615-49c9-a03f-7d077d747e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:26.063993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d54c9-4615-49c9-a03f-7d077d747e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:26.065063 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d54c9-4615-49c9-a03f-7d077d747e55 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:26.065871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d54c9-4615-49c9-a03f-7d077d747e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:26.067988 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d54c9-4615-49c9-a03f-7d077d747e55 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:26.184991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 868/1704] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:25 2022] POST /identity/v3/users => generated 282 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:26.189143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340759c8-e65e-4cf9-a5f5-ddd74882253d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:26.200828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340759c8-e65e-4cf9-a5f5-ddd74882253d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:26.213382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10171f00-b382-45f5-a23e-45e3f2a9407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:26.214768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10171f00-b382-45f5-a23e-45e3f2a9407d admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:26.215315 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10171f00-b382-45f5-a23e-45e3f2a9407d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:26.215688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10171f00-b382-45f5-a23e-45e3f2a9407d admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:26.216589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10171f00-b382-45f5-a23e-45e3f2a9407d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:26.218373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10171f00-b382-45f5-a23e-45e3f2a9407d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:26.237189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 837/1705] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:26.240941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d54c9-4615-49c9-a03f-7d077d747e55 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:26.254638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d54c9-4615-49c9-a03f-7d077d747e55 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:26.263065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27052ed4-1218-4cdf-adcd-1483a1476e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:26.263782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27052ed4-1218-4cdf-adcd-1483a1476e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:26.264059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27052ed4-1218-4cdf-adcd-1483a1476e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:26.264327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27052ed4-1218-4cdf-adcd-1483a1476e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:26.265030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27052ed4-1218-4cdf-adcd-1483a1476e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:26.266671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27052ed4-1218-4cdf-adcd-1483a1476e15 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:26.293076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 869/1706] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:26.293326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10171f00-b382-45f5-a23e-45e3f2a9407d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:26.306769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10171f00-b382-45f5-a23e-45e3f2a9407d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:26.312775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65091d7c-2d73-46b3-91f3-223ad49a4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:26.314035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65091d7c-2d73-46b3-91f3-223ad49a4292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:26.315379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65091d7c-2d73-46b3-91f3-223ad49a4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:26.315835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65091d7c-2d73-46b3-91f3-223ad49a4292 admin admin] PATH_INFO: `/v3/projects/985e3ef20415431093dbc356e070d675/users/50114d0e942a4490af1b358c5b4c72e1/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:26.336229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65091d7c-2d73-46b3-91f3-223ad49a4292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985e3ef20415431093dbc356e070d675, user_id=50114d0e942a4490af1b358c5b4c72e1, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:26.342590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65091d7c-2d73-46b3-91f3-223ad49a4292 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:26.471031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 838/1707] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:26 2022] PUT /identity/v3/projects/985e3ef20415431093dbc356e070d675/users/50114d0e942a4490af1b358c5b4c72e1/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:26.489843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355fabe-1035-409b-bc60-0b15a22fd70e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:26.490128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355fabe-1035-409b-bc60-0b15a22fd70e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:26.490515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355fabe-1035-409b-bc60-0b15a22fd70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:26.565664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a355fabe-1035-409b-bc60-0b15a22fd70e None None] MFA Rules not processed for user `50114d0e942a4490af1b358c5b4c72e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:26.567069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a355fabe-1035-409b-bc60-0b15a22fd70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:26.700313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 870/1708] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:26.705562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65091d7c-2d73-46b3-91f3-223ad49a4292 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:26.951244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65091d7c-2d73-46b3-91f3-223ad49a4292 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:26.997487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845b7c-8cb0-418f-90cf-9a8a1b45d6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:26.997487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845b7c-8cb0-418f-90cf-9a8a1b45d6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:26.997487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845b7c-8cb0-418f-90cf-9a8a1b45d6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:26.997487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845b7c-8cb0-418f-90cf-9a8a1b45d6d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:26.998137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845b7c-8cb0-418f-90cf-9a8a1b45d6d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:26.998137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845b7c-8cb0-418f-90cf-9a8a1b45d6d0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:27.061839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489f06-169b-46de-85e0-e2f90b9afe70 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:27.066050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489f06-169b-46de-85e0-e2f90b9afe70 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:27.066050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489f06-169b-46de-85e0-e2f90b9afe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:27.108386 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:27.140390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-23489f06-169b-46de-85e0-e2f90b9afe70 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:27.140390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-23489f06-169b-46de-85e0-e2f90b9afe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:27.164335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:27.178906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 839/1709] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:26 2022] POST /identity/v3/projects => generated 363 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:27.183218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845b7c-8cb0-418f-90cf-9a8a1b45d6d0 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:27.296227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 871/1710] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:25:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:27.352610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845b7c-8cb0-418f-90cf-9a8a1b45d6d0 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:27.361065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50916ad9-87e9-431a-bfac-6b8cba24276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:27.361757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50916ad9-87e9-431a-bfac-6b8cba24276e admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:27.362128 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50916ad9-87e9-431a-bfac-6b8cba24276e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:27.362910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50916ad9-87e9-431a-bfac-6b8cba24276e admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:27.363118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50916ad9-87e9-431a-bfac-6b8cba24276e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:27.366514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50916ad9-87e9-431a-bfac-6b8cba24276e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:27.522847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 840/1711] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:27 2022] POST /identity/v3/users => generated 288 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:27.526908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23489f06-169b-46de-85e0-e2f90b9afe70 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:27.543346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23489f06-169b-46de-85e0-e2f90b9afe70 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:27.572462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd9448-bd07-4c4d-ae61-9aa7e92da99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:27.573217 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9448-bd07-4c4d-ae61-9aa7e92da99d admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:27.579151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9448-bd07-4c4d-ae61-9aa7e92da99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:27.579151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9448-bd07-4c4d-ae61-9aa7e92da99d admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:27.579151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd9448-bd07-4c4d-ae61-9aa7e92da99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:27.581644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd9448-bd07-4c4d-ae61-9aa7e92da99d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:27.617441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 872/1712] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:27.625845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50916ad9-87e9-431a-bfac-6b8cba24276e admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:27.647806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50916ad9-87e9-431a-bfac-6b8cba24276e admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:27.673084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9740240-2f85-4bae-b953-c342db7d57fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:27.679988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9740240-2f85-4bae-b953-c342db7d57fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:27.679988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9740240-2f85-4bae-b953-c342db7d57fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:27.679988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9740240-2f85-4bae-b953-c342db7d57fb admin admin] PATH_INFO: `/v3/projects/edb504bd94b841a5ba5786f5935ad4b1/users/64bb2035c0554fc89b582bedcb7d053d/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:27.680258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd9448-bd07-4c4d-ae61-9aa7e92da99d admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:27.680258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5ffd9448-bd07-4c4d-ae61-9aa7e92da99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:27.703562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9740240-2f85-4bae-b953-c342db7d57fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb504bd94b841a5ba5786f5935ad4b1, user_id=64bb2035c0554fc89b582bedcb7d053d, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:27.711196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9740240-2f85-4bae-b953-c342db7d57fb admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:27.791287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 841/1713] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:27 2022] PUT /identity/v3/projects/edb504bd94b841a5ba5786f5935ad4b1/users/64bb2035c0554fc89b582bedcb7d053d/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:27.797702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9740240-2f85-4bae-b953-c342db7d57fb admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:27.883329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd9448-bd07-4c4d-ae61-9aa7e92da99d admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:27.957143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9740240-2f85-4bae-b953-c342db7d57fb admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:27.965665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2a911-81c6-4fd7-911e-8704d7ae0dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:27.966744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2a911-81c6-4fd7-911e-8704d7ae0dea admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:27.967497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2a911-81c6-4fd7-911e-8704d7ae0dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:27.968016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2a911-81c6-4fd7-911e-8704d7ae0dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:27.969416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2a911-81c6-4fd7-911e-8704d7ae0dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:27.970663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2a911-81c6-4fd7-911e-8704d7ae0dea admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:27.986361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 842/1714] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:27.988065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2a911-81c6-4fd7-911e-8704d7ae0dea admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:28.000048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2a911-81c6-4fd7-911e-8704d7ae0dea admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:28.005751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce7fe2-2a33-4cd2-b7d1-a559a1095a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:28.007795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7fe2-2a33-4cd2-b7d1-a559a1095a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:28.007795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7fe2-2a33-4cd2-b7d1-a559a1095a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:28.007795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7fe2-2a33-4cd2-b7d1-a559a1095a59 admin admin] PATH_INFO: `/v3/projects/edb504bd94b841a5ba5786f5935ad4b1/users/64bb2035c0554fc89b582bedcb7d053d/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:28.010448 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce7fe2-2a33-4cd2-b7d1-a559a1095a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb504bd94b841a5ba5786f5935ad4b1, user_id=64bb2035c0554fc89b582bedcb7d053d, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:28.013650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce7fe2-2a33-4cd2-b7d1-a559a1095a59 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:28.035868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 843/1715] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:27 2022] PUT /identity/v3/projects/edb504bd94b841a5ba5786f5935ad4b1/users/64bb2035c0554fc89b582bedcb7d053d/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:28.038729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb29de-cef6-46cd-a8f2-afb23e81ead2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:28.039346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb29de-cef6-46cd-a8f2-afb23e81ead2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:28.039849 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb29de-cef6-46cd-a8f2-afb23e81ead2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:28.129002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-4dfb29de-cef6-46cd-a8f2-afb23e81ead2 None None] MFA Rules not processed for user `64bb2035c0554fc89b582bedcb7d053d`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:28.130498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4dfb29de-cef6-46cd-a8f2-afb23e81ead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:28.168194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfe7c9-57e7-4aa4-9b1b-9a364883f83e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:28.176577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfe7c9-57e7-4aa4-9b1b-9a364883f83e service swift] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:28.177084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfe7c9-57e7-4aa4-9b1b-9a364883f83e service swift] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:28.177630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfe7c9-57e7-4aa4-9b1b-9a364883f83e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:28.197085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:28.214515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:28.319386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 844/1716] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:28.402346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfe7c9-57e7-4aa4-9b1b-9a364883f83e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:28.402346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfe7c9-57e7-4aa4-9b1b-9a364883f83e service swift] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:28.419792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb29de-cef6-46cd-a8f2-afb23e81ead2 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:28.422371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4dfb29de-cef6-46cd-a8f2-afb23e81ead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:28.436820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 873/1717] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:25:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 05:25:28.733822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb29de-cef6-46cd-a8f2-afb23e81ead2 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:28.771808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0de4d4-fa9f-4136-a80a-726f7430f299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:28.773917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de4d4-fa9f-4136-a80a-726f7430f299 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:28.778196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de4d4-fa9f-4136-a80a-726f7430f299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:28.781482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de4d4-fa9f-4136-a80a-726f7430f299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:28.850620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0de4d4-fa9f-4136-a80a-726f7430f299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:28.863994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0de4d4-fa9f-4136-a80a-726f7430f299 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:28.916268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 845/1718] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:25:29.146870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafe78c-0234-4437-9d0c-0c437ddb594d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:29.147893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafe78c-0234-4437-9d0c-0c437ddb594d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:29.147893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafe78c-0234-4437-9d0c-0c437ddb594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:29.344312 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-edafe78c-0234-4437-9d0c-0c437ddb594d None None] MFA Rules not processed for user `4213a478acfe4cc88df41b3da2d581ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:29.352905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-edafe78c-0234-4437-9d0c-0c437ddb594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:29.643572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 874/1719] 10.222.0.66 () {58 vars in 1015 bytes} [Thu Aug 4 05:25:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:29.751332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0de4d4-fa9f-4136-a80a-726f7430f299 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:29.756698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0c0de4d4-fa9f-4136-a80a-726f7430f299 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:29.763305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafe78c-0234-4437-9d0c-0c437ddb594d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:29.774547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0de4d4-fa9f-4136-a80a-726f7430f299 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:29.782083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafe78c-0234-4437-9d0c-0c437ddb594d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:29.782299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed948b36-4c65-4293-98c0-147613cdd1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:29.783407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed948b36-4c65-4293-98c0-147613cdd1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:29.784262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed948b36-4c65-4293-98c0-147613cdd1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:29.784835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed948b36-4c65-4293-98c0-147613cdd1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:29.793896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1919ec3-2982-4d6b-82d1-af6801c8aca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:29.794725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1919ec3-2982-4d6b-82d1-af6801c8aca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:29.795200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1919ec3-2982-4d6b-82d1-af6801c8aca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:29.795535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1919ec3-2982-4d6b-82d1-af6801c8aca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:29.801072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed948b36-4c65-4293-98c0-147613cdd1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:29.803974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed948b36-4c65-4293-98c0-147613cdd1b5 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:29.817820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 846/1720] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:29.850049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1919ec3-2982-4d6b-82d1-af6801c8aca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:29.852175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1919ec3-2982-4d6b-82d1-af6801c8aca8 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:29.868354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 875/1721] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:25:32.857884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63ee50-8aec-4da9-8357-89dd7a8d0e85 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:32.861060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c1db0-d8fe-4ee4-9997-6d50dc01eb23 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:32.861548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63ee50-8aec-4da9-8357-89dd7a8d0e85 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:32.861548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63ee50-8aec-4da9-8357-89dd7a8d0e85 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:32.861715 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c1db0-d8fe-4ee4-9997-6d50dc01eb23 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:32.862274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c1db0-d8fe-4ee4-9997-6d50dc01eb23 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:32.868325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 847/1722] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:25:32 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:25:32.872354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 876/1723] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:25:32 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:25:32.967555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748539a0-c8e9-4fc3-aa62-03a62766e162 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:32.967555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748539a0-c8e9-4fc3-aa62-03a62766e162 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:32.967555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748539a0-c8e9-4fc3-aa62-03a62766e162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:32.968428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbc96f-0f24-4efe-b068-97192e3d0c67 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:32.968428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbc96f-0f24-4efe-b068-97192e3d0c67 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:32.968428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbc96f-0f24-4efe-b068-97192e3d0c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:32.968428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-32dbc96f-0f24-4efe-b068-97192e3d0c67 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:32.968428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-32dbc96f-0f24-4efe-b068-97192e3d0c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:32.991337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-748539a0-c8e9-4fc3-aa62-03a62766e162 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:32.993816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-748539a0-c8e9-4fc3-aa62-03a62766e162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:33.125889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 848/1724] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:25:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:33.146087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 877/1725] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:25:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:33.168253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbc96f-0f24-4efe-b068-97192e3d0c67 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:33.169666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-32dbc96f-0f24-4efe-b068-97192e3d0c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:33.186402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbc96f-0f24-4efe-b068-97192e3d0c67 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:33.192637 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2439eb-0341-4a67-8b11-01a4d4854369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:33.193318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2439eb-0341-4a67-8b11-01a4d4854369 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:33.193596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2439eb-0341-4a67-8b11-01a4d4854369 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:33.193895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2439eb-0341-4a67-8b11-01a4d4854369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:33.220058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2439eb-0341-4a67-8b11-01a4d4854369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:33.220058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2439eb-0341-4a67-8b11-01a4d4854369 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:33.232077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 849/1726] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:33.302834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748539a0-c8e9-4fc3-aa62-03a62766e162 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:33.302834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-748539a0-c8e9-4fc3-aa62-03a62766e162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:33.312359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748539a0-c8e9-4fc3-aa62-03a62766e162 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:33.319691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe893993-11f1-4a85-95f1-24cb3ff81c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:33.320898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893993-11f1-4a85-95f1-24cb3ff81c67 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:33.321204 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893993-11f1-4a85-95f1-24cb3ff81c67 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:33.321548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893993-11f1-4a85-95f1-24cb3ff81c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:33.335730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe893993-11f1-4a85-95f1-24cb3ff81c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:33.337362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe893993-11f1-4a85-95f1-24cb3ff81c67 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:33.361347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 878/1727] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:33.444625 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2439eb-0341-4a67-8b11-01a4d4854369 service nova] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:33.496816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:33.518078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2439eb-0341-4a67-8b11-01a4d4854369 service nova] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:33.522828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:33.523461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:33.523918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:33.524259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] PATH_INFO: `/v3/users/50114d0e942a4490af1b358c5b4c72e1` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:33.525490 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50114d0e942a4490af1b358c5b4c72e1)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:33.527935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:33.781124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50114d0e942a4490af1b358c5b4c72e1'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:33.781708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50114d0e942a4490af1b358c5b4c72e1'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:33.789080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50114d0e942a4490af1b358c5b4c72e1'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:33.789714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50114d0e942a4490af1b358c5b4c72e1'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:33.897583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50114d0e942a4490af1b358c5b4c72e1'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:33.923284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 850/1728] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:33 2022] DELETE /identity/v3/users/50114d0e942a4490af1b358c5b4c72e1 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:33.926421 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405588-1cee-4178-8743-662954d2f587 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:33.927148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405588-1cee-4178-8743-662954d2f587 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:33.927148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405588-1cee-4178-8743-662954d2f587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:33.950465 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-36405588-1cee-4178-8743-662954d2f587 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:33.951699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-36405588-1cee-4178-8743-662954d2f587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:33.966344 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:34.045231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 879/1729] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:34.052789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:34.054421 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:34.134687 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299db6a-8a53-4997-ae2a-9d382ac2aaf5 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:34.139529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5e388-af8b-4f2d-a763-20c29ffb6782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:34.140292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5e388-af8b-4f2d-a763-20c29ffb6782 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:34.140578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5e388-af8b-4f2d-a763-20c29ffb6782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:34.140883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5e388-af8b-4f2d-a763-20c29ffb6782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:34.154867 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5e388-af8b-4f2d-a763-20c29ffb6782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:34.156345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5e388-af8b-4f2d-a763-20c29ffb6782 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:34.169348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 851/1730] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:35.301399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36405588-1cee-4178-8743-662954d2f587 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:35.301399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-36405588-1cee-4178-8743-662954d2f587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:35.309286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36405588-1cee-4178-8743-662954d2f587 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:35.316019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:35.316679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:35.316996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:35.317235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] PATH_INFO: `/v3/projects/985e3ef20415431093dbc356e070d675` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:35.318643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985e3ef20415431093dbc356e070d675)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:35.333400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:35.624257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985e3ef20415431093dbc356e070d675', 'request_id': 'req-38b57edd-e199-4b03-bb38-936fb46c0fb2'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:35.647448 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985e3ef20415431093dbc356e070d675', 'request_id': 'req-38b57edd-e199-4b03-bb38-936fb46c0fb2'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:35.708760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5e388-af8b-4f2d-a763-20c29ffb6782 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:35.711419 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c3d5e388-af8b-4f2d-a763-20c29ffb6782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:35.732379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5e388-af8b-4f2d-a763-20c29ffb6782 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:35.779328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985e3ef20415431093dbc356e070d675', 'request_id': 'req-38b57edd-e199-4b03-bb38-936fb46c0fb2'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:35.799070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] The token cache is being invalidate because project 985e3ef20415431093dbc356e070d675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:35.799569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:35.800651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:35.831333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 880/1731] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:35 2022] DELETE /identity/v3/projects/985e3ef20415431093dbc356e070d675 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:35.831333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:35.842854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:35.853558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:35.858815 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:35.858815 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:35.858815 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] PATH_INFO: `/v3/users/67a0ea0d8987485aaa91ca2670608ba4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:35.858815 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a0ea0d8987485aaa91ca2670608ba4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:35.873350 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:35.886284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:35.954328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b57edd-e199-4b03-bb38-936fb46c0fb2 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:35.954328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:35.955370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:35.956198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:35.956944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] PATH_INFO: `/v3/users/64bb2035c0554fc89b582bedcb7d053d` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:35.961829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=64bb2035c0554fc89b582bedcb7d053d)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:35.968878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:36.320998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64bb2035c0554fc89b582bedcb7d053d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.322521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64bb2035c0554fc89b582bedcb7d053d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.329885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a0ea0d8987485aaa91ca2670608ba4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.331400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a0ea0d8987485aaa91ca2670608ba4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.342821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64bb2035c0554fc89b582bedcb7d053d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.355764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a0ea0d8987485aaa91ca2670608ba4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.356804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a0ea0d8987485aaa91ca2670608ba4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.375667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64bb2035c0554fc89b582bedcb7d053d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.580535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4ac64ea2-4395-4fdb-8e21-715c3b29a75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a0ea0d8987485aaa91ca2670608ba4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.607247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 852/1732] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:35 2022] DELETE /identity/v3/users/67a0ea0d8987485aaa91ca2670608ba4 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:36.618593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4988d-5ce3-43b8-864f-e09ea23dccfe None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:36.620766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4988d-5ce3-43b8-864f-e09ea23dccfe None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:36.620766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4988d-5ce3-43b8-864f-e09ea23dccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:36.642212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64bb2035c0554fc89b582bedcb7d053d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.652641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 881/1733] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:35 2022] DELETE /identity/v3/users/64bb2035c0554fc89b582bedcb7d053d => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:36.665024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-a7b4988d-5ce3-43b8-864f-e09ea23dccfe None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:36.666462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a7b4988d-5ce3-43b8-864f-e09ea23dccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:36.951912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 853/1734] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:37.119955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:37.124079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:37.192900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:37.285125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6febc-ba5a-4c7c-a19f-2b75b4e378ca admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:37.285125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f891-8733-4ac7-96bb-b4f8faa43def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:37.285125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f891-8733-4ac7-96bb-b4f8faa43def service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:37.285125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f891-8733-4ac7-96bb-b4f8faa43def service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:37.285994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f891-8733-4ac7-96bb-b4f8faa43def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:37.329965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f891-8733-4ac7-96bb-b4f8faa43def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:37.333530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f891-8733-4ac7-96bb-b4f8faa43def service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:37.368306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 882/1735] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:39.601110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4988d-5ce3-43b8-864f-e09ea23dccfe None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:39.602744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a7b4988d-5ce3-43b8-864f-e09ea23dccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:39.624431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4988d-5ce3-43b8-864f-e09ea23dccfe None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:39.643190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:39.645344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:39.645614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:39.647874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] PATH_INFO: `/v3/projects/edb504bd94b841a5ba5786f5935ad4b1` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:39.652621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb504bd94b841a5ba5786f5935ad4b1)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:39.655764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:40.060689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f891-8733-4ac7-96bb-b4f8faa43def service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:40.064283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-df95f891-8733-4ac7-96bb-b4f8faa43def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:40.105035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f891-8733-4ac7-96bb-b4f8faa43def service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:40.106043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb504bd94b841a5ba5786f5935ad4b1', 'request_id': 'req-9ccf1232-692d-47e4-9d34-e7c7ca66da84'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:40.120122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb504bd94b841a5ba5786f5935ad4b1', 'request_id': 'req-9ccf1232-692d-47e4-9d34-e7c7ca66da84'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:40.268990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:40.271148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.271508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.271935 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] PATH_INFO: `/v3/projects/3f2966fde4034c0aae9d1814d5dd01dc` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.273284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2966fde4034c0aae9d1814d5dd01dc)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:40.275549 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:40.349486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb504bd94b841a5ba5786f5935ad4b1', 'request_id': 'req-9ccf1232-692d-47e4-9d34-e7c7ca66da84'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:40.363642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] The token cache is being invalidate because project edb504bd94b841a5ba5786f5935ad4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:40.363935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:40.364669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9ccf1232-692d-47e4-9d34-e7c7ca66da84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:40.366244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 854/1736] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:39 2022] DELETE /identity/v3/projects/edb504bd94b841a5ba5786f5935ad4b1 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:40.372013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724794de-3341-4612-9eec-3538118f697a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.372431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724794de-3341-4612-9eec-3538118f697a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.372560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724794de-3341-4612-9eec-3538118f697a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.395938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-724794de-3341-4612-9eec-3538118f697a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:40.405847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-724794de-3341-4612-9eec-3538118f697a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:40.406735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 855/1737] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:40.415864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d351-4efa-43d6-9745-6e4f6c346324 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.416138 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d351-4efa-43d6-9745-6e4f6c346324 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.416483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d351-4efa-43d6-9745-6e4f6c346324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.438894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-3c26d351-4efa-43d6-9745-6e4f6c346324 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:40.440139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3c26d351-4efa-43d6-9745-6e4f6c346324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:40.449356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 856/1738] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:40.454204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d351-4efa-43d6-9745-6e4f6c346324 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:40.467469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d351-4efa-43d6-9745-6e4f6c346324 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:40.473121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599b7aa-83c0-4bee-b27a-75ce41551ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:40.473760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599b7aa-83c0-4bee-b27a-75ce41551ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.474094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599b7aa-83c0-4bee-b27a-75ce41551ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.474302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599b7aa-83c0-4bee-b27a-75ce41551ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.481106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599b7aa-83c0-4bee-b27a-75ce41551ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:40.481106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599b7aa-83c0-4bee-b27a-75ce41551ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:40.481106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599b7aa-83c0-4bee-b27a-75ce41551ce6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:40.490117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 857/1739] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:25:40.494620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599b7aa-83c0-4bee-b27a-75ce41551ce6 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:40.507404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599b7aa-83c0-4bee-b27a-75ce41551ce6 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:40.522512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2966fde4034c0aae9d1814d5dd01dc', 'request_id': 'req-01d90fcc-6408-4216-9cf0-a48c17d78b04'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:40.530129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2966fde4034c0aae9d1814d5dd01dc', 'request_id': 'req-01d90fcc-6408-4216-9cf0-a48c17d78b04'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:40.584452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad828-0fa3-456e-a85d-7333f1a4abb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:40.585091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad828-0fa3-456e-a85d-7333f1a4abb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.585368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad828-0fa3-456e-a85d-7333f1a4abb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.585664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad828-0fa3-456e-a85d-7333f1a4abb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.586374 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaad828-0fa3-456e-a85d-7333f1a4abb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:40.588298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaad828-0fa3-456e-a85d-7333f1a4abb8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:40.629028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2966fde4034c0aae9d1814d5dd01dc', 'request_id': 'req-01d90fcc-6408-4216-9cf0-a48c17d78b04'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:40.641141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:40.641765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] The token cache is being invalidate because project 3f2966fde4034c0aae9d1814d5dd01dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:40.641765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:40.642149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-01d90fcc-6408-4216-9cf0-a48c17d78b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:40.643794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 883/1740] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:40 2022] DELETE /identity/v3/projects/3f2966fde4034c0aae9d1814d5dd01dc => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:40.648800 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935e0b0-64f5-42a7-8076-61511957053b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.649089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935e0b0-64f5-42a7-8076-61511957053b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.649363 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935e0b0-64f5-42a7-8076-61511957053b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.672021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-7935e0b0-64f5-42a7-8076-61511957053b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:40.676027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7935e0b0-64f5-42a7-8076-61511957053b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:40.677001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 858/1741] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:40 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:25:40.681177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad828-0fa3-456e-a85d-7333f1a4abb8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:40.683659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2aaad828-0fa3-456e-a85d-7333f1a4abb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:40.751290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 884/1742] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:40.757253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad828-0fa3-456e-a85d-7333f1a4abb8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:40.762211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8a71-c2c1-44dc-8d4c-1b5c08fea88c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.762211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8a71-c2c1-44dc-8d4c-1b5c08fea88c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.762211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8a71-c2c1-44dc-8d4c-1b5c08fea88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.763244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215ed6-5d0f-4e69-9068-88fa9123dde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:40.763926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215ed6-5d0f-4e69-9068-88fa9123dde7 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.764209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215ed6-5d0f-4e69-9068-88fa9123dde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.764485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215ed6-5d0f-4e69-9068-88fa9123dde7 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.765151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4215ed6-5d0f-4e69-9068-88fa9123dde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:40.767163 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4215ed6-5d0f-4e69-9068-88fa9123dde7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:40.781714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-6f1f8a71-c2c1-44dc-8d4c-1b5c08fea88c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:40.782963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6f1f8a71-c2c1-44dc-8d4c-1b5c08fea88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:40.791218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 885/1743] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:40.795585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8a71-c2c1-44dc-8d4c-1b5c08fea88c None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:40.804952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8a71-c2c1-44dc-8d4c-1b5c08fea88c None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:40.811133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79c3ce-524f-4802-8cfc-af53f25c1f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:40.812064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79c3ce-524f-4802-8cfc-af53f25c1f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.812387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79c3ce-524f-4802-8cfc-af53f25c1f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.812673 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79c3ce-524f-4802-8cfc-af53f25c1f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.813856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79c3ce-524f-4802-8cfc-af53f25c1f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:40.815293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79c3ce-524f-4802-8cfc-af53f25c1f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:40.817304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79c3ce-524f-4802-8cfc-af53f25c1f7c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:40.831973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 886/1744] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:25:40.837215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79c3ce-524f-4802-8cfc-af53f25c1f7c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:40.852412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79c3ce-524f-4802-8cfc-af53f25c1f7c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:40.860740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8567b7-4284-4e0c-9a1a-7382e0f2a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:40.861495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8567b7-4284-4e0c-9a1a-7382e0f2a475 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.861903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8567b7-4284-4e0c-9a1a-7382e0f2a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.862334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8567b7-4284-4e0c-9a1a-7382e0f2a475 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.863309 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8567b7-4284-4e0c-9a1a-7382e0f2a475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:40.865449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8567b7-4284-4e0c-9a1a-7382e0f2a475 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:40.878461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 859/1745] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:40 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:25:40.884200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215ed6-5d0f-4e69-9068-88fa9123dde7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:40.898650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215ed6-5d0f-4e69-9068-88fa9123dde7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:40.909038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afd39b-f1f1-4316-a392-c27e7fb34bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:40.910095 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afd39b-f1f1-4316-a392-c27e7fb34bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.910877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afd39b-f1f1-4316-a392-c27e7fb34bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.911669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afd39b-f1f1-4316-a392-c27e7fb34bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.912962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afd39b-f1f1-4316-a392-c27e7fb34bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:40.916428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afd39b-f1f1-4316-a392-c27e7fb34bd9 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:40.937917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 860/1746] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:40.941985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afd39b-f1f1-4316-a392-c27e7fb34bd9 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:40.953351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afd39b-f1f1-4316-a392-c27e7fb34bd9 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:40.958135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142ab7-1e08-4c23-b80b-a6cb61dcdfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:40.958793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142ab7-1e08-4c23-b80b-a6cb61dcdfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:40.959075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142ab7-1e08-4c23-b80b-a6cb61dcdfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:40.959347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142ab7-1e08-4c23-b80b-a6cb61dcdfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:40.960040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b142ab7-1e08-4c23-b80b-a6cb61dcdfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:40.961667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b142ab7-1e08-4c23-b80b-a6cb61dcdfb5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:40.981887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 861/1747] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:25:40.987379 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 887/1748] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:40 2022] POST /identity/v3/projects => generated 403 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:25:40.987585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142ab7-1e08-4c23-b80b-a6cb61dcdfb5 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:40.988544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8567b7-4284-4e0c-9a1a-7382e0f2a475 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:41.005509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142ab7-1e08-4c23-b80b-a6cb61dcdfb5 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:41.082338 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8567b7-4284-4e0c-9a1a-7382e0f2a475 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:41.089602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b7f60-d834-4e56-a24a-da4bf7b0e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:41.090669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7f60-d834-4e56-a24a-da4bf7b0e7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.090669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7f60-d834-4e56-a24a-da4bf7b0e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.091047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7f60-d834-4e56-a24a-da4bf7b0e7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.092306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b7f60-d834-4e56-a24a-da4bf7b0e7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:41.094474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b7f60-d834-4e56-a24a-da4bf7b0e7b5 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:41.098446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef927915-a366-4eb9-bbe0-b0c59c718f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:41.099538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef927915-a366-4eb9-bbe0-b0c59c718f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.100263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef927915-a366-4eb9-bbe0-b0c59c718f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.100434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef927915-a366-4eb9-bbe0-b0c59c718f6c admin admin] PATH_INFO: `/v3/projects/046388c0fdd849e09d4e44c84ba1b976/users/fe26cb9a60f443f298ea663d3fa3f2c5/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.123000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef927915-a366-4eb9-bbe0-b0c59c718f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=046388c0fdd849e09d4e44c84ba1b976, user_id=fe26cb9a60f443f298ea663d3fa3f2c5, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:41.125175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:41.128319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef927915-a366-4eb9-bbe0-b0c59c718f6c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:41.222171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 888/1749] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:40 2022] POST /identity/v3/users => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:41.226816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b7f60-d834-4e56-a24a-da4bf7b0e7b5 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:41.236020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 862/1750] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:40 2022] PUT /identity/v3/projects/046388c0fdd849e09d4e44c84ba1b976/users/fe26cb9a60f443f298ea663d3fa3f2c5/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:41.250028 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f306107-dc64-4bc6-a8fe-13412bd9509c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.250342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f306107-dc64-4bc6-a8fe-13412bd9509c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.250665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f306107-dc64-4bc6-a8fe-13412bd9509c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.259260 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b7f60-d834-4e56-a24a-da4bf7b0e7b5 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:41.310411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-6f306107-dc64-4bc6-a8fe-13412bd9509c None None] MFA Rules not processed for user `fe26cb9a60f443f298ea663d3fa3f2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:41.311702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6f306107-dc64-4bc6-a8fe-13412bd9509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:41.346381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6c77c-2dc1-4fe1-9d53-39e0f5a66f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:41.347274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6c77c-2dc1-4fe1-9d53-39e0f5a66f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.347744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6c77c-2dc1-4fe1-9d53-39e0f5a66f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.349903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6c77c-2dc1-4fe1-9d53-39e0f5a66f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.350669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6c77c-2dc1-4fe1-9d53-39e0f5a66f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:41.353728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6c77c-2dc1-4fe1-9d53-39e0f5a66f7e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:41.376102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 889/1751] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:41.380793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6c77c-2dc1-4fe1-9d53-39e0f5a66f7e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:41.392195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6c77c-2dc1-4fe1-9d53-39e0f5a66f7e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:41.397923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dfc46-ac51-48a3-b2b8-8c3e39311045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:41.399685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dfc46-ac51-48a3-b2b8-8c3e39311045 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.399685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dfc46-ac51-48a3-b2b8-8c3e39311045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.399685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dfc46-ac51-48a3-b2b8-8c3e39311045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.400219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dfc46-ac51-48a3-b2b8-8c3e39311045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:41.403035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dfc46-ac51-48a3-b2b8-8c3e39311045 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:41.414624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 863/1752] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:41.415290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 890/1753] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:41.421768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f306107-dc64-4bc6-a8fe-13412bd9509c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:41.421984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dfc46-ac51-48a3-b2b8-8c3e39311045 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:41.433468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f306107-dc64-4bc6-a8fe-13412bd9509c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:41.433930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dfc46-ac51-48a3-b2b8-8c3e39311045 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:41.439230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa0325-02b8-45b5-b3fc-45444f23bfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:41.439386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5758aea-96bf-4e04-8f63-5b25c726d980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:41.439914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa0325-02b8-45b5-b3fc-45444f23bfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.440196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa0325-02b8-45b5-b3fc-45444f23bfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.440440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5758aea-96bf-4e04-8f63-5b25c726d980 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.440523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5758aea-96bf-4e04-8f63-5b25c726d980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.440945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5758aea-96bf-4e04-8f63-5b25c726d980 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.441345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa0325-02b8-45b5-b3fc-45444f23bfc7 admin admin] PATH_INFO: `/v3/projects/32011147488b4dac9c53113c8ffa5ec4/users/4abb283c85194bb7bf634eb2ce20c4cd/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.441768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5758aea-96bf-4e04-8f63-5b25c726d980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:41.443892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5758aea-96bf-4e04-8f63-5b25c726d980 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:41.465229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa0325-02b8-45b5-b3fc-45444f23bfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32011147488b4dac9c53113c8ffa5ec4, user_id=4abb283c85194bb7bf634eb2ce20c4cd, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:41.468728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa0325-02b8-45b5-b3fc-45444f23bfc7 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:41.554770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 864/1754] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:41 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:41.555971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5758aea-96bf-4e04-8f63-5b25c726d980 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:41.578110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 891/1755] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:41 2022] PUT /identity/v3/projects/32011147488b4dac9c53113c8ffa5ec4/users/4abb283c85194bb7bf634eb2ce20c4cd/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:41.587074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560c20d-5ea9-48a6-ba04-922346fac238 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.587280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560c20d-5ea9-48a6-ba04-922346fac238 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.587554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560c20d-5ea9-48a6-ba04-922346fac238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.608334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-2560c20d-5ea9-48a6-ba04-922346fac238 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:41.609581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2560c20d-5ea9-48a6-ba04-922346fac238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:41.621699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5758aea-96bf-4e04-8f63-5b25c726d980 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:41.676505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 892/1756] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:41.687235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560c20d-5ea9-48a6-ba04-922346fac238 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:41.688947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2560c20d-5ea9-48a6-ba04-922346fac238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:41.696832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829bf4e-3eaa-4220-85b8-282aab1986ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:41.697756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829bf4e-3eaa-4220-85b8-282aab1986ea admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.697756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829bf4e-3eaa-4220-85b8-282aab1986ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.698589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829bf4e-3eaa-4220-85b8-282aab1986ea admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.699416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829bf4e-3eaa-4220-85b8-282aab1986ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:41.701344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829bf4e-3eaa-4220-85b8-282aab1986ea admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:41.755754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560c20d-5ea9-48a6-ba04-922346fac238 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:41.759385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a2109-51a3-40a6-95f9-12aeacbc3bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:41.759993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a2109-51a3-40a6-95f9-12aeacbc3bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.760268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a2109-51a3-40a6-95f9-12aeacbc3bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.760730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a2109-51a3-40a6-95f9-12aeacbc3bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.770995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a2109-51a3-40a6-95f9-12aeacbc3bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:41.776037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a2109-51a3-40a6-95f9-12aeacbc3bd7 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:41.783451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 893/1757] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:25:41.848493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 865/1758] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:41 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:25:41.852655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a2109-51a3-40a6-95f9-12aeacbc3bd7 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:41.864555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a2109-51a3-40a6-95f9-12aeacbc3bd7 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:41.869769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a83cc-fa86-4023-ae83-ffee6bb205a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:41.871215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a83cc-fa86-4023-ae83-ffee6bb205a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.871565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a83cc-fa86-4023-ae83-ffee6bb205a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.871837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a83cc-fa86-4023-ae83-ffee6bb205a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.872532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a83cc-fa86-4023-ae83-ffee6bb205a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:41.874223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a83cc-fa86-4023-ae83-ffee6bb205a2 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:41.885211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 894/1759] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:41.896539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829bf4e-3eaa-4220-85b8-282aab1986ea admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:41.901655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829bf4e-3eaa-4220-85b8-282aab1986ea admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:41.906989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95a4c7-8e33-456d-9c9c-76e3267179f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:41.907670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95a4c7-8e33-456d-9c9c-76e3267179f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:41.907943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95a4c7-8e33-456d-9c9c-76e3267179f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:41.908214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95a4c7-8e33-456d-9c9c-76e3267179f5 admin admin] PATH_INFO: `/v3/projects/6571f363af494713816529e807ccd36c/users/159177aa31034b91b51f7f835488d8b5/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:41.925651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95a4c7-8e33-456d-9c9c-76e3267179f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6571f363af494713816529e807ccd36c, user_id=159177aa31034b91b51f7f835488d8b5, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:41.928408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95a4c7-8e33-456d-9c9c-76e3267179f5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:42.030832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 866/1760] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:41 2022] PUT /identity/v3/projects/6571f363af494713816529e807ccd36c/users/159177aa31034b91b51f7f835488d8b5/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:42.035100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a83cc-fa86-4023-ae83-ffee6bb205a2 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:42.046513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a83cc-fa86-4023-ae83-ffee6bb205a2 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:42.110449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e290e7e-4916-42f1-ac45-b136ae2bd8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:42.111103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290e7e-4916-42f1-ac45-b136ae2bd8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:42.111245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290e7e-4916-42f1-ac45-b136ae2bd8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:42.111512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290e7e-4916-42f1-ac45-b136ae2bd8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:42.112206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e290e7e-4916-42f1-ac45-b136ae2bd8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:42.113953 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e290e7e-4916-42f1-ac45-b136ae2bd8d1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:42.125317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 895/1761] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:42.129566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95a4c7-8e33-456d-9c9c-76e3267179f5 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:42.140406 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95a4c7-8e33-456d-9c9c-76e3267179f5 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:42.145006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8217901-01aa-444b-88b0-efc17cbe8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:42.145685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8217901-01aa-444b-88b0-efc17cbe8f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:42.145963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8217901-01aa-444b-88b0-efc17cbe8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:42.146235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8217901-01aa-444b-88b0-efc17cbe8f3a admin admin] PATH_INFO: `/v3/projects/6571f363af494713816529e807ccd36c/users/159177aa31034b91b51f7f835488d8b5/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:42.148296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8217901-01aa-444b-88b0-efc17cbe8f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6571f363af494713816529e807ccd36c, user_id=159177aa31034b91b51f7f835488d8b5, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:42.151783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8217901-01aa-444b-88b0-efc17cbe8f3a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:42.178591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 867/1762] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:42 2022] PUT /identity/v3/projects/6571f363af494713816529e807ccd36c/users/159177aa31034b91b51f7f835488d8b5/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:42.189755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978c98-692f-4f56-8393-b4cd85d1096f None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:42.190038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978c98-692f-4f56-8393-b4cd85d1096f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:42.190345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978c98-692f-4f56-8393-b4cd85d1096f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:42.224656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9e978c98-692f-4f56-8393-b4cd85d1096f None None] MFA Rules not processed for user `159177aa31034b91b51f7f835488d8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:42.225899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9e978c98-692f-4f56-8393-b4cd85d1096f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:42.346390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 896/1763] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:42.365414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8217901-01aa-444b-88b0-efc17cbe8f3a admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:42.368340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d8217901-01aa-444b-88b0-efc17cbe8f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:42.466978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8217901-01aa-444b-88b0-efc17cbe8f3a admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:42.482562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d067b-755b-457e-b044-a71777fec4f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:42.483445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d067b-755b-457e-b044-a71777fec4f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:42.483740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d067b-755b-457e-b044-a71777fec4f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:42.484039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d067b-755b-457e-b044-a71777fec4f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:42.505236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d067b-755b-457e-b044-a71777fec4f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:42.511336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d067b-755b-457e-b044-a71777fec4f7 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:42.530603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 868/1764] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:42.852524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:43.799546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09edc5-c610-4fec-8add-e4f8063b030f None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:43.800199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09edc5-c610-4fec-8add-e4f8063b030f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:43.800199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09edc5-c610-4fec-8add-e4f8063b030f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:43.850842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-eb09edc5-c610-4fec-8add-e4f8063b030f None None] MFA Rules not processed for user `4abb283c85194bb7bf634eb2ce20c4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:43.854933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-eb09edc5-c610-4fec-8add-e4f8063b030f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:43.982589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 897/1765] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:43.988322 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d067b-755b-457e-b044-a71777fec4f7 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:44.064192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:44.108386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d067b-755b-457e-b044-a71777fec4f7 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:44.130911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15b107-06c1-448d-9752-510a1bc754a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:44.131858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15b107-06c1-448d-9752-510a1bc754a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:44.132300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15b107-06c1-448d-9752-510a1bc754a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:44.132901 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15b107-06c1-448d-9752-510a1bc754a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:44.147464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15b107-06c1-448d-9752-510a1bc754a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:44.149848 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15b107-06c1-448d-9752-510a1bc754a4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:44.329032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 869/1766] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:43 2022] POST /identity/v3/projects => generated 405 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:25:44.330016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09edc5-c610-4fec-8add-e4f8063b030f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:44.343283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09edc5-c610-4fec-8add-e4f8063b030f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:44.500675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207db0-1278-4912-828f-9db42f976ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:44.502604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207db0-1278-4912-828f-9db42f976ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:44.503149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207db0-1278-4912-828f-9db42f976ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:44.503613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207db0-1278-4912-828f-9db42f976ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:44.504522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea207db0-1278-4912-828f-9db42f976ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:44.507082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea207db0-1278-4912-828f-9db42f976ea3 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:44.628044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 898/1767] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:44 2022] POST /identity/v3/users => generated 309 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:44.633658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15b107-06c1-448d-9752-510a1bc754a4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:44.648536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15b107-06c1-448d-9752-510a1bc754a4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:44.665684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be3ff6-4bb3-49a7-9fd2-b9d33e139b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:44.667296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be3ff6-4bb3-49a7-9fd2-b9d33e139b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:44.667982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be3ff6-4bb3-49a7-9fd2-b9d33e139b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:44.668469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be3ff6-4bb3-49a7-9fd2-b9d33e139b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:44.670050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be3ff6-4bb3-49a7-9fd2-b9d33e139b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:44.673159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be3ff6-4bb3-49a7-9fd2-b9d33e139b65 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:44.696410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 870/1768] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:44.701222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207db0-1278-4912-828f-9db42f976ea3 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:44.721162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207db0-1278-4912-828f-9db42f976ea3 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:44.733944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187d9ed-9d4e-45f6-9d6d-2f7aa5da70c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:44.735066 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187d9ed-9d4e-45f6-9d6d-2f7aa5da70c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:44.739235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187d9ed-9d4e-45f6-9d6d-2f7aa5da70c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:44.743933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187d9ed-9d4e-45f6-9d6d-2f7aa5da70c8 admin admin] PATH_INFO: `/v3/projects/76d5309875d74ee4acd4bc2cd3ada45e/users/18c3b43abdab4f048db3ea68c03ad43d/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:44.761114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187d9ed-9d4e-45f6-9d6d-2f7aa5da70c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d5309875d74ee4acd4bc2cd3ada45e, user_id=18c3b43abdab4f048db3ea68c03ad43d, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:44.764452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187d9ed-9d4e-45f6-9d6d-2f7aa5da70c8 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:44.881277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 899/1769] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:44 2022] PUT /identity/v3/projects/76d5309875d74ee4acd4bc2cd3ada45e/users/18c3b43abdab4f048db3ea68c03ad43d/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:44.885951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be3ff6-4bb3-49a7-9fd2-b9d33e139b65 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:44.897192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be3ff6-4bb3-49a7-9fd2-b9d33e139b65 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:44.967248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0580-f9cf-4dd1-8381-b5039c7e8f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:44.967906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0580-f9cf-4dd1-8381-b5039c7e8f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:44.968184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0580-f9cf-4dd1-8381-b5039c7e8f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:44.968458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0580-f9cf-4dd1-8381-b5039c7e8f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:44.969376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0580-f9cf-4dd1-8381-b5039c7e8f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:44.970895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0580-f9cf-4dd1-8381-b5039c7e8f11 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:44.982657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 871/1770] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:44.988056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187d9ed-9d4e-45f6-9d6d-2f7aa5da70c8 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:45.004365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187d9ed-9d4e-45f6-9d6d-2f7aa5da70c8 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:45.006784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc38a6-13ae-43bd-b309-0a921b92afed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:45.007492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc38a6-13ae-43bd-b309-0a921b92afed admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:45.007771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc38a6-13ae-43bd-b309-0a921b92afed admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:45.008041 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc38a6-13ae-43bd-b309-0a921b92afed admin admin] PATH_INFO: `/v3/projects/76d5309875d74ee4acd4bc2cd3ada45e/users/18c3b43abdab4f048db3ea68c03ad43d/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:45.010221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc38a6-13ae-43bd-b309-0a921b92afed admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d5309875d74ee4acd4bc2cd3ada45e, user_id=18c3b43abdab4f048db3ea68c03ad43d, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:45.013484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc38a6-13ae-43bd-b309-0a921b92afed admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:45.025637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 900/1771] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:44 2022] PUT /identity/v3/projects/76d5309875d74ee4acd4bc2cd3ada45e/users/18c3b43abdab4f048db3ea68c03ad43d/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:45.315427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:46.132967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:46.859689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bac2a-ae40-4f94-8204-74701701b0ea None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:46.860173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bac2a-ae40-4f94-8204-74701701b0ea None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:46.860339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bac2a-ae40-4f94-8204-74701701b0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:46.891523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e19bac2a-ae40-4f94-8204-74701701b0ea None None] MFA Rules not processed for user `18c3b43abdab4f048db3ea68c03ad43d`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:46.892767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e19bac2a-ae40-4f94-8204-74701701b0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:46.938478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:46.974071 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 872/1772] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:47.036487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:47.770253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc38a6-13ae-43bd-b309-0a921b92afed admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:47.832919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2248b5-f215-44b4-afd4-1ded45a970ce None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:47.833608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2248b5-f215-44b4-afd4-1ded45a970ce None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:47.834129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2248b5-f215-44b4-afd4-1ded45a970ce None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:47.835912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 873/1773] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:25:47.849695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc38a6-13ae-43bd-b309-0a921b92afed admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:47.853252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c609-239c-4733-ae9e-3d57361b8077 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:47.853646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c609-239c-4733-ae9e-3d57361b8077 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:47.854731 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c609-239c-4733-ae9e-3d57361b8077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:47.856764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:47.857439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:47.857715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:47.858036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] PATH_INFO: `/v3/users/fe26cb9a60f443f298ea663d3fa3f2c5` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:47.859411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe26cb9a60f443f298ea663d3fa3f2c5)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:47.866335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:47.879085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-7168c609-239c-4733-ae9e-3d57361b8077 None None] MFA Rules not processed for user `448d43be14a74865a1e0d09e76c7e248`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:47.880361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7168c609-239c-4733-ae9e-3d57361b8077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:47.956062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 874/1774] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:25:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:47.973751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168c609-239c-4733-ae9e-3d57361b8077 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:47.975381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7168c609-239c-4733-ae9e-3d57361b8077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:47.994556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168c609-239c-4733-ae9e-3d57361b8077 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:47.995509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1691f3f-b65b-45e6-a402-fe43595a64ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:47.996163 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691f3f-b65b-45e6-a402-fe43595a64ac service placement] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:47.996444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691f3f-b65b-45e6-a402-fe43595a64ac service placement] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:47.996713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691f3f-b65b-45e6-a402-fe43595a64ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:48.007258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1691f3f-b65b-45e6-a402-fe43595a64ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:48.009262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1691f3f-b65b-45e6-a402-fe43595a64ac service placement] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:48.022745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 875/1775] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:25:48.097103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe26cb9a60f443f298ea663d3fa3f2c5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:48.097835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe26cb9a60f443f298ea663d3fa3f2c5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:48.109450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe26cb9a60f443f298ea663d3fa3f2c5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:48.127282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe26cb9a60f443f298ea663d3fa3f2c5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:48.193120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe26cb9a60f443f298ea663d3fa3f2c5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:48.196658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 901/1776] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:47 2022] DELETE /identity/v3/users/fe26cb9a60f443f298ea663d3fa3f2c5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:48.202260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3122fee-3398-4424-aef8-5e55b6ee0853 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:48.202656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3122fee-3398-4424-aef8-5e55b6ee0853 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:48.203003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3122fee-3398-4424-aef8-5e55b6ee0853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:48.224026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b3122fee-3398-4424-aef8-5e55b6ee0853 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:48.233227 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b3122fee-3398-4424-aef8-5e55b6ee0853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:48.289711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 876/1777] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:48.300431 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:48.301860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:48.361403 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36d0f5-107d-42f8-bcd3-4aa9b179cd1b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:48.365018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba34080-424f-4ccb-8efa-3dcfbeb0d2c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:48.365632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34080-424f-4ccb-8efa-3dcfbeb0d2c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:48.365905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34080-424f-4ccb-8efa-3dcfbeb0d2c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:48.366666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34080-424f-4ccb-8efa-3dcfbeb0d2c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:48.378971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba34080-424f-4ccb-8efa-3dcfbeb0d2c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:48.380411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba34080-424f-4ccb-8efa-3dcfbeb0d2c1 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:48.392105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 902/1778] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:48.550628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:48.836699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3122fee-3398-4424-aef8-5e55b6ee0853 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:48.838290 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b3122fee-3398-4424-aef8-5e55b6ee0853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:48.852201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3122fee-3398-4424-aef8-5e55b6ee0853 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:48.860174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba34080-424f-4ccb-8efa-3dcfbeb0d2c1 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:48.861064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:48.861570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4ba34080-424f-4ccb-8efa-3dcfbeb0d2c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:48.862058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:48.862510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:48.863786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] PATH_INFO: `/v3/users/4abb283c85194bb7bf634eb2ce20c4cd` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:48.864332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abb283c85194bb7bf634eb2ce20c4cd)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:48.867364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:48.876418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba34080-424f-4ccb-8efa-3dcfbeb0d2c1 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:48.881138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:48.886783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:48.886783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:48.886783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] PATH_INFO: `/v3/projects/046388c0fdd849e09d4e44c84ba1b976` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:48.886783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046388c0fdd849e09d4e44c84ba1b976)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:48.886783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:48.898254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:49.074475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046388c0fdd849e09d4e44c84ba1b976', 'request_id': 'req-6680f83d-5433-4f52-a669-a3c1f7e40f98'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.078617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abb283c85194bb7bf634eb2ce20c4cd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.084231 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abb283c85194bb7bf634eb2ce20c4cd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.085203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046388c0fdd849e09d4e44c84ba1b976', 'request_id': 'req-6680f83d-5433-4f52-a669-a3c1f7e40f98'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.088137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abb283c85194bb7bf634eb2ce20c4cd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.089403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abb283c85194bb7bf634eb2ce20c4cd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.149116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046388c0fdd849e09d4e44c84ba1b976', 'request_id': 'req-6680f83d-5433-4f52-a669-a3c1f7e40f98'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.167460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] The token cache is being invalidate because project 046388c0fdd849e09d4e44c84ba1b976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:49.168365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.169164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.171127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 903/1779] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:48 2022] DELETE /identity/v3/projects/046388c0fdd849e09d4e44c84ba1b976 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:49.175585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:49.177173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:49.235489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abb283c85194bb7bf634eb2ce20c4cd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.258177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 877/1780] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:48 2022] DELETE /identity/v3/users/4abb283c85194bb7bf634eb2ce20c4cd => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:49.280811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680f83d-5433-4f52-a669-a3c1f7e40f98 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:49.347548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:49.348202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:49.348480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:49.348753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] PATH_INFO: `/v3/users/159177aa31034b91b51f7f835488d8b5` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:49.349983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=159177aa31034b91b51f7f835488d8b5)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:49.352100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:49.540354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159177aa31034b91b51f7f835488d8b5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.541031 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159177aa31034b91b51f7f835488d8b5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.554842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159177aa31034b91b51f7f835488d8b5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.556088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:49.557989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:49.572927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b3afe-5348-49c6-bb57-245d4f36e26d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:49.578348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:49.579164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159177aa31034b91b51f7f835488d8b5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.579327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:49.579637 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:49.580015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] PATH_INFO: `/v3/projects/32011147488b4dac9c53113c8ffa5ec4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:49.581398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=32011147488b4dac9c53113c8ffa5ec4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:49.583436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:49.640768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159177aa31034b91b51f7f835488d8b5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.647434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 904/1781] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:49 2022] DELETE /identity/v3/users/159177aa31034b91b51f7f835488d8b5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:49.762864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32011147488b4dac9c53113c8ffa5ec4', 'request_id': 'req-6b625453-9055-47a0-848b-f86e844c6c9a'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.769364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32011147488b4dac9c53113c8ffa5ec4', 'request_id': 'req-6b625453-9055-47a0-848b-f86e844c6c9a'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.880526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32011147488b4dac9c53113c8ffa5ec4', 'request_id': 'req-6b625453-9055-47a0-848b-f86e844c6c9a'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.891243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:49.895956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] The token cache is being invalidate because project 32011147488b4dac9c53113c8ffa5ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:49.896255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.897082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:49.899012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 878/1782] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:49 2022] DELETE /identity/v3/projects/32011147488b4dac9c53113c8ffa5ec4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:49.906202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:49.908060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:49.984098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5dfd0-3842-465c-9031-f3a790e08227 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:50.052945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:50.053561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:50.053849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:50.054126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] PATH_INFO: `/v3/users/18c3b43abdab4f048db3ea68c03ad43d` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:50.055378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c3b43abdab4f048db3ea68c03ad43d)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:50.057433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:50.132853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:50.134352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:50.149699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b625453-9055-47a0-848b-f86e844c6c9a admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:50.158791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:50.160659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:50.161090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:50.168583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] PATH_INFO: `/v3/projects/6571f363af494713816529e807ccd36c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:50.169522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6571f363af494713816529e807ccd36c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:50.171795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:50.230760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:50.274322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c3b43abdab4f048db3ea68c03ad43d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.277847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c3b43abdab4f048db3ea68c03ad43d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.291396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c3b43abdab4f048db3ea68c03ad43d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.306085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c3b43abdab4f048db3ea68c03ad43d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.311425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6571f363af494713816529e807ccd36c', 'request_id': 'req-f643fc90-92ae-47ba-8aeb-93f35bf625a5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.319402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6571f363af494713816529e807ccd36c', 'request_id': 'req-f643fc90-92ae-47ba-8aeb-93f35bf625a5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.384026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c3b43abdab4f048db3ea68c03ad43d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.399994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 905/1783] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:49 2022] DELETE /identity/v3/users/18c3b43abdab4f048db3ea68c03ad43d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:50.401814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:50.403367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:50.457764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6571f363af494713816529e807ccd36c', 'request_id': 'req-f643fc90-92ae-47ba-8aeb-93f35bf625a5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.479232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] The token cache is being invalidate because project 6571f363af494713816529e807ccd36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:50.479591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.481288 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-f643fc90-92ae-47ba-8aeb-93f35bf625a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.483632 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 879/1784] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:50 2022] DELETE /identity/v3/projects/6571f363af494713816529e807ccd36c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:50.490966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe562a-2a94-4793-8eed-3277735451b1 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:50.490966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe562a-2a94-4793-8eed-3277735451b1 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:50.490966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe562a-2a94-4793-8eed-3277735451b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:50.501649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf56102-870d-4e92-b3ca-b47b3a59e9ad admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:50.507329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:50.508578 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:50.509042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:50.509502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] PATH_INFO: `/v3/users/3135c7d1fc554a9db9d809a45442737a` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:50.511225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3135c7d1fc554a9db9d809a45442737a)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:50.513515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:50.534801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-15fe562a-2a94-4793-8eed-3277735451b1 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:50.539921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-15fe562a-2a94-4793-8eed-3277735451b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:50.552313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 880/1785] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:50.560407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a6d30-ccfd-4606-bbf3-41043abc05f2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:50.560666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a6d30-ccfd-4606-bbf3-41043abc05f2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:50.560970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a6d30-ccfd-4606-bbf3-41043abc05f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:50.582070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-2f9a6d30-ccfd-4606-bbf3-41043abc05f2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:50.583396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2f9a6d30-ccfd-4606-bbf3-41043abc05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:50.594460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 881/1786] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:50.598713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a6d30-ccfd-4606-bbf3-41043abc05f2 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:50.624964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a6d30-ccfd-4606-bbf3-41043abc05f2 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:50.632183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66be48-c96b-46f4-89e8-b6b6ebe39073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:50.632976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66be48-c96b-46f4-89e8-b6b6ebe39073 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:50.633318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66be48-c96b-46f4-89e8-b6b6ebe39073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:50.633688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66be48-c96b-46f4-89e8-b6b6ebe39073 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:50.634585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66be48-c96b-46f4-89e8-b6b6ebe39073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:50.634906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66be48-c96b-46f4-89e8-b6b6ebe39073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:50.637694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66be48-c96b-46f4-89e8-b6b6ebe39073 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:50.654346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 882/1787] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:25:50.658704 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66be48-c96b-46f4-89e8-b6b6ebe39073 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:50.670169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66be48-c96b-46f4-89e8-b6b6ebe39073 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:50.674836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55f356-72e5-43c5-8174-ccb3fcb18ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:50.675450 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f356-72e5-43c5-8174-ccb3fcb18ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:50.675725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f356-72e5-43c5-8174-ccb3fcb18ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:50.675996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f356-72e5-43c5-8174-ccb3fcb18ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:50.676664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55f356-72e5-43c5-8174-ccb3fcb18ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:50.678636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55f356-72e5-43c5-8174-ccb3fcb18ec3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:50.757987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3135c7d1fc554a9db9d809a45442737a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.759131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3135c7d1fc554a9db9d809a45442737a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.766753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3135c7d1fc554a9db9d809a45442737a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.780555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3135c7d1fc554a9db9d809a45442737a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.797087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 883/1788] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:50 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:25:50.798021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55f356-72e5-43c5-8174-ccb3fcb18ec3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:50.799868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-de55f356-72e5-43c5-8174-ccb3fcb18ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:50.863377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3135c7d1fc554a9db9d809a45442737a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:50.870222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55f356-72e5-43c5-8174-ccb3fcb18ec3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:50.871710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 906/1789] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:50 2022] DELETE /identity/v3/users/3135c7d1fc554a9db9d809a45442737a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:50.872568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:50.876049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:50.938181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:50.939151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:50.939455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:50.939694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] PATH_INFO: `/v3/projects/76d5309875d74ee4acd4bc2cd3ada45e` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:50.940999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d5309875d74ee4acd4bc2cd3ada45e)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:50.942962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:50.951814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ae892-6d47-4c6b-8b20-c48604335ca0 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:50.957807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb411e81-111a-4d81-b285-1f2445196a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:50.958517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb411e81-111a-4d81-b285-1f2445196a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:50.958796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb411e81-111a-4d81-b285-1f2445196a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:50.959063 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb411e81-111a-4d81-b285-1f2445196a52 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:50.959741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb411e81-111a-4d81-b285-1f2445196a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:50.961626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb411e81-111a-4d81-b285-1f2445196a52 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:51.110177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 907/1790] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:50 2022] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:51.111512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d541f6-fb02-4e7a-850c-250a7afa3d0a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.111868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d541f6-fb02-4e7a-850c-250a7afa3d0a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.112148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d541f6-fb02-4e7a-850c-250a7afa3d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.123452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d5309875d74ee4acd4bc2cd3ada45e', 'request_id': 'req-23739929-f187-4cad-a1e9-c03a55e2bcc7'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:51.129979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d5309875d74ee4acd4bc2cd3ada45e', 'request_id': 'req-23739929-f187-4cad-a1e9-c03a55e2bcc7'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:51.132620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-01d541f6-fb02-4e7a-850c-250a7afa3d0a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:51.133850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-01d541f6-fb02-4e7a-850c-250a7afa3d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:51.196388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 908/1791] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:51.197385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d541f6-fb02-4e7a-850c-250a7afa3d0a None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:51.207075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:51.207599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d541f6-fb02-4e7a-850c-250a7afa3d0a None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:51.213265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e639c-a529-4520-b2f4-8f98dd11a8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:51.214907 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e639c-a529-4520-b2f4-8f98dd11a8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.215008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e639c-a529-4520-b2f4-8f98dd11a8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.215561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e639c-a529-4520-b2f4-8f98dd11a8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.216428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e639c-a529-4520-b2f4-8f98dd11a8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:51.218024 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e639c-a529-4520-b2f4-8f98dd11a8d2 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:51.228594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 909/1792] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:51.230348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e639c-a529-4520-b2f4-8f98dd11a8d2 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:51.232049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a68e639c-a529-4520-b2f4-8f98dd11a8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:51.257669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d5309875d74ee4acd4bc2cd3ada45e', 'request_id': 'req-23739929-f187-4cad-a1e9-c03a55e2bcc7'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:51.270499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] The token cache is being invalidate because project 76d5309875d74ee4acd4bc2cd3ada45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:51.271062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:51.272112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:51.274183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 884/1793] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:50 2022] DELETE /identity/v3/projects/76d5309875d74ee4acd4bc2cd3ada45e => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:51.275933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:51.278406 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:51.295021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23739929-f187-4cad-a1e9-c03a55e2bcc7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:51.296409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e639c-a529-4520-b2f4-8f98dd11a8d2 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:51.300076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d70d3-5feb-4e23-8815-6f90e9522068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:51.300688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d70d3-5feb-4e23-8815-6f90e9522068 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.300965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d70d3-5feb-4e23-8815-6f90e9522068 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.301236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d70d3-5feb-4e23-8815-6f90e9522068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.301644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f02d7-9515-4c43-94ee-22254035ead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:51.302596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f02d7-9515-4c43-94ee-22254035ead8 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.303062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f02d7-9515-4c43-94ee-22254035ead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.303181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c70d70d3-5feb-4e23-8815-6f90e9522068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:51.303623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f02d7-9515-4c43-94ee-22254035ead8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.304585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f02d7-9515-4c43-94ee-22254035ead8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:51.306623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f02d7-9515-4c43-94ee-22254035ead8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:51.315949 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d70d3-5feb-4e23-8815-6f90e9522068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:51.317390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d70d3-5feb-4e23-8815-6f90e9522068 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:51.321337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 885/1794] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:51.324739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f18b9-dbf9-4bfe-8fc1-ab5651491207 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.324739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f18b9-dbf9-4bfe-8fc1-ab5651491207 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.324739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f18b9-dbf9-4bfe-8fc1-ab5651491207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.329186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 910/1795] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:51.330011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d70d3-5feb-4e23-8815-6f90e9522068 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:51.340619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d70d3-5feb-4e23-8815-6f90e9522068 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:51.348063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ab3f18b9-dbf9-4bfe-8fc1-ab5651491207 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:51.353372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624ea8-d77a-49c1-9c8f-37bf2a85dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:51.353657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ab3f18b9-dbf9-4bfe-8fc1-ab5651491207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:51.353753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624ea8-d77a-49c1-9c8f-37bf2a85dfd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.353753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624ea8-d77a-49c1-9c8f-37bf2a85dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.353753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624ea8-d77a-49c1-9c8f-37bf2a85dfd9 admin admin] PATH_INFO: `/v3/projects/7297d74f4059466aa3118b868635b24e/users/6845cfd733b349debafaa215bbee8000/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.366655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 886/1796] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:51.372643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a2b07-98e5-433b-aafe-90c50c7550d4 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.373022 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a2b07-98e5-433b-aafe-90c50c7550d4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.373304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a2b07-98e5-433b-aafe-90c50c7550d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.381700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58624ea8-d77a-49c1-9c8f-37bf2a85dfd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7297d74f4059466aa3118b868635b24e, user_id=6845cfd733b349debafaa215bbee8000, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:51.387175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58624ea8-d77a-49c1-9c8f-37bf2a85dfd9 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:51.418707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-de7a2b07-98e5-433b-aafe-90c50c7550d4 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:51.420084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-de7a2b07-98e5-433b-aafe-90c50c7550d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:51.429605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 887/1797] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:51.436254 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a2b07-98e5-433b-aafe-90c50c7550d4 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:51.448788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a2b07-98e5-433b-aafe-90c50c7550d4 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:51.459069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82ebde-67bc-4559-a3cd-34d7cedb04d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:51.460105 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82ebde-67bc-4559-a3cd-34d7cedb04d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.460588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82ebde-67bc-4559-a3cd-34d7cedb04d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.461060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82ebde-67bc-4559-a3cd-34d7cedb04d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.462178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82ebde-67bc-4559-a3cd-34d7cedb04d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:51.462808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82ebde-67bc-4559-a3cd-34d7cedb04d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:51.464892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82ebde-67bc-4559-a3cd-34d7cedb04d6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:51.483508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 888/1798] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:25:51.486024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82ebde-67bc-4559-a3cd-34d7cedb04d6 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:51.497326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82ebde-67bc-4559-a3cd-34d7cedb04d6 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:51.502436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca57a1c-b2e5-4a86-afa7-b092b4281156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:51.503069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca57a1c-b2e5-4a86-afa7-b092b4281156 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.503365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca57a1c-b2e5-4a86-afa7-b092b4281156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.503642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca57a1c-b2e5-4a86-afa7-b092b4281156 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.504313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca57a1c-b2e5-4a86-afa7-b092b4281156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:51.506257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca57a1c-b2e5-4a86-afa7-b092b4281156 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:51.521528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 911/1799] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:51 2022] PUT /identity/v3/projects/7297d74f4059466aa3118b868635b24e/users/6845cfd733b349debafaa215bbee8000/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:51.534117 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a33ea6-7c35-41f9-8ae4-a514b046b24b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.534727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a33ea6-7c35-41f9-8ae4-a514b046b24b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.535677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a33ea6-7c35-41f9-8ae4-a514b046b24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.568244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-84a33ea6-7c35-41f9-8ae4-a514b046b24b None None] MFA Rules not processed for user `6845cfd733b349debafaa215bbee8000`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:51.569724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-84a33ea6-7c35-41f9-8ae4-a514b046b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:51.630151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 889/1800] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:51 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:51.631500 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca57a1c-b2e5-4a86-afa7-b092b4281156 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:51.685818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 912/1801] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:51.693157 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a33ea6-7c35-41f9-8ae4-a514b046b24b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:51.720863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:51.815888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca57a1c-b2e5-4a86-afa7-b092b4281156 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:51.837969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4912e-6215-4e80-9971-529d3f2ecbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:51.838417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4912e-6215-4e80-9971-529d3f2ecbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.839231 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4912e-6215-4e80-9971-529d3f2ecbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.839512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4912e-6215-4e80-9971-529d3f2ecbf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.840189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4912e-6215-4e80-9971-529d3f2ecbf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:51.842181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4912e-6215-4e80-9971-529d3f2ecbf7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:51.876542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a33ea6-7c35-41f9-8ae4-a514b046b24b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:51.882849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92e654-ea29-4c88-afb5-6dfc9420d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:51.883494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92e654-ea29-4c88-afb5-6dfc9420d2ce admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:51.883768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92e654-ea29-4c88-afb5-6dfc9420d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:51.884035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92e654-ea29-4c88-afb5-6dfc9420d2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:51.884708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92e654-ea29-4c88-afb5-6dfc9420d2ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:51.886709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92e654-ea29-4c88-afb5-6dfc9420d2ce admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:52.025937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 890/1802] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:51 2022] POST /identity/v3/users => generated 290 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:52.054800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4912e-6215-4e80-9971-529d3f2ecbf7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:52.060408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 913/1803] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:51 2022] POST /identity/v3/projects => generated 361 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:52.062632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dff15-9661-46a9-b6a6-62e8e6e8f739 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.063547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dff15-9661-46a9-b6a6-62e8e6e8f739 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.064017 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dff15-9661-46a9-b6a6-62e8e6e8f739 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.067511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 914/1804] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:25:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:25:52.069162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dff15-9661-46a9-b6a6-62e8e6e8f739 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:52.116388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4912e-6215-4e80-9971-529d3f2ecbf7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:52.255923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dff15-9661-46a9-b6a6-62e8e6e8f739 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:52.262591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b7562-ccfd-4853-932c-7f2ec55e5430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:52.264255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b7562-ccfd-4853-932c-7f2ec55e5430 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.264642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b7562-ccfd-4853-932c-7f2ec55e5430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.264983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b7562-ccfd-4853-932c-7f2ec55e5430 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.265824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b7562-ccfd-4853-932c-7f2ec55e5430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:52.268148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b7562-ccfd-4853-932c-7f2ec55e5430 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:52.271235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b23743-8d47-4af5-a760-dc12865f50e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:52.273400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b23743-8d47-4af5-a760-dc12865f50e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.273688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b23743-8d47-4af5-a760-dc12865f50e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.274051 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b23743-8d47-4af5-a760-dc12865f50e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.274957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b23743-8d47-4af5-a760-dc12865f50e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:52.276787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b23743-8d47-4af5-a760-dc12865f50e1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:52.290968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 891/1805] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:52.302342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3081a-448c-4534-9127-0b25f541ef05 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.303168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3081a-448c-4534-9127-0b25f541ef05 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.303168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3081a-448c-4534-9127-0b25f541ef05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.327571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-a5f3081a-448c-4534-9127-0b25f541ef05 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:52.329177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a5f3081a-448c-4534-9127-0b25f541ef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:52.404883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 892/1806] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:25:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:52.404883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3081a-448c-4534-9127-0b25f541ef05 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:52.407328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a5f3081a-448c-4534-9127-0b25f541ef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:52.422225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3081a-448c-4534-9127-0b25f541ef05 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:52.426881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:52.427517 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.427799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.428070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] PATH_INFO: `/v3/projects/cb23bca3b73a462f9081b3be1513d437` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.429213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb23bca3b73a462f9081b3be1513d437)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:52.431131 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:52.457516 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 915/1807] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:52 2022] POST /identity/v3/users => generated 287 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:52.459099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b7562-ccfd-4853-932c-7f2ec55e5430 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:52.486109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b7562-ccfd-4853-932c-7f2ec55e5430 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:52.486109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3189050-b43d-4a8b-96b2-3bd63ff55fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:52.486109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3189050-b43d-4a8b-96b2-3bd63ff55fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.486109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3189050-b43d-4a8b-96b2-3bd63ff55fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.486515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3189050-b43d-4a8b-96b2-3bd63ff55fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.486515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3189050-b43d-4a8b-96b2-3bd63ff55fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:52.487273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3189050-b43d-4a8b-96b2-3bd63ff55fdf admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:52.501330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 916/1808] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:52.501330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3189050-b43d-4a8b-96b2-3bd63ff55fdf admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:52.502885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b3189050-b43d-4a8b-96b2-3bd63ff55fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:52.519791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3189050-b43d-4a8b-96b2-3bd63ff55fdf admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:52.527167 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0d20d-aad0-4a76-97e3-0dc3730489bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:52.527941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0d20d-aad0-4a76-97e3-0dc3730489bd service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.528322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0d20d-aad0-4a76-97e3-0dc3730489bd service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.528598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0d20d-aad0-4a76-97e3-0dc3730489bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.538213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0d20d-aad0-4a76-97e3-0dc3730489bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:52.539861 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0d20d-aad0-4a76-97e3-0dc3730489bd service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:52.551262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 917/1809] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:52.552110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0d20d-aad0-4a76-97e3-0dc3730489bd service nova] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:52.562398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0d20d-aad0-4a76-97e3-0dc3730489bd service nova] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:52.567888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71c35b-7ffe-4c53-8051-d246bdc0a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:52.568500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c35b-7ffe-4c53-8051-d246bdc0a0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.568780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c35b-7ffe-4c53-8051-d246bdc0a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.569058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c35b-7ffe-4c53-8051-d246bdc0a0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.570064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71c35b-7ffe-4c53-8051-d246bdc0a0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:52.571679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71c35b-7ffe-4c53-8051-d246bdc0a0d5 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:52.583982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb23bca3b73a462f9081b3be1513d437', 'request_id': 'req-db3fd088-4cca-4b20-9b3d-a14d727b334e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:52.586504 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 918/1810] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:52.587690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71c35b-7ffe-4c53-8051-d246bdc0a0d5 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:52.592758 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb23bca3b73a462f9081b3be1513d437', 'request_id': 'req-db3fd088-4cca-4b20-9b3d-a14d727b334e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:52.601623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71c35b-7ffe-4c53-8051-d246bdc0a0d5 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:52.681492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61baf17-316a-43a6-808d-63461ffb3970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:52.682210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61baf17-316a-43a6-808d-63461ffb3970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.682585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61baf17-316a-43a6-808d-63461ffb3970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.682879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61baf17-316a-43a6-808d-63461ffb3970 admin admin] PATH_INFO: `/v3/projects/069395b5eb744d9d92762ee4c19b99f1/users/2a04673beff0461d868aa2f30c52bab8/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.706084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61baf17-316a-43a6-808d-63461ffb3970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069395b5eb744d9d92762ee4c19b99f1, user_id=2a04673beff0461d868aa2f30c52bab8, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:52.708960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61baf17-316a-43a6-808d-63461ffb3970 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:52.715818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb23bca3b73a462f9081b3be1513d437', 'request_id': 'req-db3fd088-4cca-4b20-9b3d-a14d727b334e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:52.732780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] The token cache is being invalidate because project cb23bca3b73a462f9081b3be1513d437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:52.733072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:52.733760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:52.735380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 893/1811] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:52 2022] DELETE /identity/v3/projects/cb23bca3b73a462f9081b3be1513d437 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:52.737405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:52.738860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:52.752560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd088-4cca-4b20-9b3d-a14d727b334e admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:52.757209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33d564-dca1-44ca-8b99-081ab5a51bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:52.757863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33d564-dca1-44ca-8b99-081ab5a51bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.758143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33d564-dca1-44ca-8b99-081ab5a51bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.758457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33d564-dca1-44ca-8b99-081ab5a51bc1 admin admin] PATH_INFO: `/v3/projects/7b0e05faab7d4d849c0831fd64b8f5c9/users/d474786bd0034efea190fb8cc049b9cf/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.774947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33d564-dca1-44ca-8b99-081ab5a51bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0e05faab7d4d849c0831fd64b8f5c9, user_id=d474786bd0034efea190fb8cc049b9cf, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:52.777807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33d564-dca1-44ca-8b99-081ab5a51bc1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:52.806868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 919/1812] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:52 2022] PUT /identity/v3/projects/069395b5eb744d9d92762ee4c19b99f1/users/2a04673beff0461d868aa2f30c52bab8/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:52.806868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61baf17-316a-43a6-808d-63461ffb3970 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:52.810219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d61baf17-316a-43a6-808d-63461ffb3970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:52.849248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 894/1813] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:52 2022] PUT /identity/v3/projects/7b0e05faab7d4d849c0831fd64b8f5c9/users/d474786bd0034efea190fb8cc049b9cf/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:52.849248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aee077-8280-404b-81cd-76e404d03168 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.849786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aee077-8280-404b-81cd-76e404d03168 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.850268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aee077-8280-404b-81cd-76e404d03168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.882471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d2aee077-8280-404b-81cd-76e404d03168 None None] MFA Rules not processed for user `2a04673beff0461d868aa2f30c52bab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:52.882945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d2aee077-8280-404b-81cd-76e404d03168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:52.892052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61baf17-316a-43a6-808d-63461ffb3970 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:52.954887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 895/1814] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:52.958650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aee077-8280-404b-81cd-76e404d03168 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:52.961593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:52.962341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:52.968392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:52.968392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] PATH_INFO: `/v3/users/7e6cf22607134b8e8472cac3b92ff973` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:52.968392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6cf22607134b8e8472cac3b92ff973)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:52.968392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.022884 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aee077-8280-404b-81cd-76e404d03168 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.027716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6bd7d-ad6e-4e39-a0f8-ab3fdaa86db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.028348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd7d-ad6e-4e39-a0f8-ab3fdaa86db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.028630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd7d-ad6e-4e39-a0f8-ab3fdaa86db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.028908 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd7d-ad6e-4e39-a0f8-ab3fdaa86db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.029613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6bd7d-ad6e-4e39-a0f8-ab3fdaa86db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:53.031331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6bd7d-ad6e-4e39-a0f8-ab3fdaa86db0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.043038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 896/1815] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:53.048721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6bd7d-ad6e-4e39-a0f8-ab3fdaa86db0 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:53.048721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cec6bd7d-ad6e-4e39-a0f8-ab3fdaa86db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:53.061461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6bd7d-ad6e-4e39-a0f8-ab3fdaa86db0 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.066262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a25dc-eb87-4ac6-b8d2-d4bb1aceabc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.066906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a25dc-eb87-4ac6-b8d2-d4bb1aceabc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.067235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a25dc-eb87-4ac6-b8d2-d4bb1aceabc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.067516 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a25dc-eb87-4ac6-b8d2-d4bb1aceabc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.068186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a25dc-eb87-4ac6-b8d2-d4bb1aceabc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:53.070110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a25dc-eb87-4ac6-b8d2-d4bb1aceabc2 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.191353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 897/1816] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:53 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:53.192613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a25dc-eb87-4ac6-b8d2-d4bb1aceabc2 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:53.238737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6cf22607134b8e8472cac3b92ff973'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:53.241028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6cf22607134b8e8472cac3b92ff973'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:53.252997 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6cf22607134b8e8472cac3b92ff973'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:53.267674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a25dc-eb87-4ac6-b8d2-d4bb1aceabc2 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.269848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6cf22607134b8e8472cac3b92ff973'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:53.273644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309093d-1bec-4d85-b28b-e4af00b9c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.274171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309093d-1bec-4d85-b28b-e4af00b9c1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.274272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309093d-1bec-4d85-b28b-e4af00b9c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.274647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309093d-1bec-4d85-b28b-e4af00b9c1ca admin admin] PATH_INFO: `/v3/projects/7b0e05faab7d4d849c0831fd64b8f5c9/users/d474786bd0034efea190fb8cc049b9cf/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.277581 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309093d-1bec-4d85-b28b-e4af00b9c1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0e05faab7d4d849c0831fd64b8f5c9, user_id=d474786bd0034efea190fb8cc049b9cf, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:53.280545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309093d-1bec-4d85-b28b-e4af00b9c1ca admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.291924 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 898/1817] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:53 2022] PUT /identity/v3/projects/7b0e05faab7d4d849c0831fd64b8f5c9/users/d474786bd0034efea190fb8cc049b9cf/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:53.293495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309093d-1bec-4d85-b28b-e4af00b9c1ca admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:53.295201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c309093d-1bec-4d85-b28b-e4af00b9c1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:53.360527 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-745557ae-2793-4976-914b-71a27bb8c1b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6cf22607134b8e8472cac3b92ff973'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:53.364254 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309093d-1bec-4d85-b28b-e4af00b9c1ca admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.368293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 920/1818] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:52 2022] DELETE /identity/v3/users/7e6cf22607134b8e8472cac3b92ff973 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:53.368573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82d35-9fbc-4691-9ecf-41e7e1f99e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.369258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82d35-9fbc-4691-9ecf-41e7e1f99e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.369561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82d35-9fbc-4691-9ecf-41e7e1f99e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.369821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82d35-9fbc-4691-9ecf-41e7e1f99e16 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.370559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e82d35-9fbc-4691-9ecf-41e7e1f99e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:53.371031 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96181-fcf3-4045-9e9a-5cf266b6f28f None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.371607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96181-fcf3-4045-9e9a-5cf266b6f28f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.372620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96181-fcf3-4045-9e9a-5cf266b6f28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.376486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e82d35-9fbc-4691-9ecf-41e7e1f99e16 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.412105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-69b96181-fcf3-4045-9e9a-5cf266b6f28f None None] MFA Rules not processed for user `d474786bd0034efea190fb8cc049b9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:53.414359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-69b96181-fcf3-4045-9e9a-5cf266b6f28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:53.477291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 899/1819] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:53 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:53.481773 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82d35-9fbc-4691-9ecf-41e7e1f99e16 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:53.493389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82d35-9fbc-4691-9ecf-41e7e1f99e16 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.500134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 921/1820] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:53.512244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96181-fcf3-4045-9e9a-5cf266b6f28f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:53.513889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-69b96181-fcf3-4045-9e9a-5cf266b6f28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:53.565560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392acac-82f9-4358-ae22-d545844e065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.566202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392acac-82f9-4358-ae22-d545844e065a admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.566571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392acac-82f9-4358-ae22-d545844e065a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.566834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392acac-82f9-4358-ae22-d545844e065a admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.567607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392acac-82f9-4358-ae22-d545844e065a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:53.569325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392acac-82f9-4358-ae22-d545844e065a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.585743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96181-fcf3-4045-9e9a-5cf266b6f28f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.587331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 900/1821] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:53.591857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2ddf9-6257-4bb3-846f-fdd9e1fe72d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.592562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2ddf9-6257-4bb3-846f-fdd9e1fe72d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.592880 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2ddf9-6257-4bb3-846f-fdd9e1fe72d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.593156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2ddf9-6257-4bb3-846f-fdd9e1fe72d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.594189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392acac-82f9-4358-ae22-d545844e065a admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:53.605251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2ddf9-6257-4bb3-846f-fdd9e1fe72d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:53.606770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392acac-82f9-4358-ae22-d545844e065a admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.606887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2ddf9-6257-4bb3-846f-fdd9e1fe72d6 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.612828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4abe4-0cfb-4a01-9398-89332caa2f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.613753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4abe4-0cfb-4a01-9398-89332caa2f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.614387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4abe4-0cfb-4a01-9398-89332caa2f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.614508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4abe4-0cfb-4a01-9398-89332caa2f58 admin admin] PATH_INFO: `/v3/projects/19c17b75725648f396e7a3baead6fb98/users/25ffc546c33a4a8aade1de28a8b35dd4/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.619952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:53.622391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 922/1822] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:53.633362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4abe4-0cfb-4a01-9398-89332caa2f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c17b75725648f396e7a3baead6fb98, user_id=25ffc546c33a4a8aade1de28a8b35dd4, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:53.636822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4abe4-0cfb-4a01-9398-89332caa2f58 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.723128 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 901/1823] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:53 2022] PUT /identity/v3/projects/19c17b75725648f396e7a3baead6fb98/users/25ffc546c33a4a8aade1de28a8b35dd4/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:53.727541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2ddf9-6257-4bb3-846f-fdd9e1fe72d6 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:53.743910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2ddf9-6257-4bb3-846f-fdd9e1fe72d6 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.800472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50536dac-fd6a-41f0-bf61-91cb2d99fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.801179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536dac-fd6a-41f0-bf61-91cb2d99fd1e admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.801461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536dac-fd6a-41f0-bf61-91cb2d99fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.801775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536dac-fd6a-41f0-bf61-91cb2d99fd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.802530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50536dac-fd6a-41f0-bf61-91cb2d99fd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:53.804648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50536dac-fd6a-41f0-bf61-91cb2d99fd1e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.815831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 923/1824] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:53.820005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4abe4-0cfb-4a01-9398-89332caa2f58 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:53.831201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4abe4-0cfb-4a01-9398-89332caa2f58 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.833178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50536dac-fd6a-41f0-bf61-91cb2d99fd1e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:53.834720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-50536dac-fd6a-41f0-bf61-91cb2d99fd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:53.849217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b706b47-d26b-494f-8f9e-284711be6a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.849217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b706b47-d26b-494f-8f9e-284711be6a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.849217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b706b47-d26b-494f-8f9e-284711be6a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.849217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b706b47-d26b-494f-8f9e-284711be6a71 admin admin] PATH_INFO: `/v3/projects/19c17b75725648f396e7a3baead6fb98/users/25ffc546c33a4a8aade1de28a8b35dd4/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.849737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b706b47-d26b-494f-8f9e-284711be6a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c17b75725648f396e7a3baead6fb98, user_id=25ffc546c33a4a8aade1de28a8b35dd4, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:53.853037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b706b47-d26b-494f-8f9e-284711be6a71 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.862970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50536dac-fd6a-41f0-bf61-91cb2d99fd1e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.866805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 902/1825] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:53 2022] PUT /identity/v3/projects/19c17b75725648f396e7a3baead6fb98/users/25ffc546c33a4a8aade1de28a8b35dd4/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:53.867932 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b706b47-d26b-494f-8f9e-284711be6a71 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:53.929963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b706b47-d26b-494f-8f9e-284711be6a71 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:53.933935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb2510-6812-43e7-bfda-37ce3a02d320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.934603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb2510-6812-43e7-bfda-37ce3a02d320 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.934887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb2510-6812-43e7-bfda-37ce3a02d320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.935164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb2510-6812-43e7-bfda-37ce3a02d320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.936960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:53.937110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-37fb2510-6812-43e7-bfda-37ce3a02d320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:53.937616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:53.938154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:53.938459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] PATH_INFO: `/v3/projects/457ed96ab8764eef806ae1e7f079ea67` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:53.939762 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457ed96ab8764eef806ae1e7f079ea67)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:53.941650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:53.999530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb2510-6812-43e7-bfda-37ce3a02d320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:54.001045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb2510-6812-43e7-bfda-37ce3a02d320 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:54.010679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 903/1826] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:54.012052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd57f45-4513-4b6b-ae19-e3e985c9638c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.012342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd57f45-4513-4b6b-ae19-e3e985c9638c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.012612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd57f45-4513-4b6b-ae19-e3e985c9638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.014059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:INSERT=5,keystone:DELETE=11,keystone:SELECT=84 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:54.040817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-bfd57f45-4513-4b6b-ae19-e3e985c9638c None None] MFA Rules not processed for user `25ffc546c33a4a8aade1de28a8b35dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:54.042778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-bfd57f45-4513-4b6b-ae19-e3e985c9638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:54.062099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457ed96ab8764eef806ae1e7f079ea67', 'request_id': 'req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:54.068502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457ed96ab8764eef806ae1e7f079ea67', 'request_id': 'req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:54.126444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 904/1827] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:54.137528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457ed96ab8764eef806ae1e7f079ea67', 'request_id': 'req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:54.138989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd57f45-4513-4b6b-ae19-e3e985c9638c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:54.140331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-bfd57f45-4513-4b6b-ae19-e3e985c9638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:54.149857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] The token cache is being invalidate because project 457ed96ab8764eef806ae1e7f079ea67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:54.153864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:54.153864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aff77f67-7cae-4aa7-a0ec-9c11859be4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:54.154090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd57f45-4513-4b6b-ae19-e3e985c9638c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:54.155198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 924/1828] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:53 2022] DELETE /identity/v3/projects/457ed96ab8764eef806ae1e7f079ea67 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:54.160013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0bf09-50b6-469a-b251-0347cee88d90 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.160627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0bf09-50b6-469a-b251-0347cee88d90 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.160964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0bf09-50b6-469a-b251-0347cee88d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.190069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-5ad0bf09-50b6-469a-b251-0347cee88d90 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:54.191963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5ad0bf09-50b6-469a-b251-0347cee88d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:54.225582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd9edb-2001-45e4-b8d2-0477a8a67d92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:54.226423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd9edb-2001-45e4-b8d2-0477a8a67d92 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.226802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd9edb-2001-45e4-b8d2-0477a8a67d92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.227176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd9edb-2001-45e4-b8d2-0477a8a67d92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.230770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e5bd9edb-2001-45e4-b8d2-0477a8a67d92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:54.284595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 925/1829] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:54.295092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64145d07-9a21-40d6-879d-83095517e082 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.295661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64145d07-9a21-40d6-879d-83095517e082 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.295947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64145d07-9a21-40d6-879d-83095517e082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.310329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd9edb-2001-45e4-b8d2-0477a8a67d92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:54.312057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd9edb-2001-45e4-b8d2-0477a8a67d92 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:54.317330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-64145d07-9a21-40d6-879d-83095517e082 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:54.327734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-64145d07-9a21-40d6-879d-83095517e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:54.327887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 905/1830] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:25:54.329874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 926/1831] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:54.334046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd9edb-2001-45e4-b8d2-0477a8a67d92 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:54.348679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd9edb-2001-45e4-b8d2-0477a8a67d92 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:54.354038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bef710-78ef-4a1a-984e-ab10a4973650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:54.355405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bef710-78ef-4a1a-984e-ab10a4973650 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.357153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bef710-78ef-4a1a-984e-ab10a4973650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.357153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bef710-78ef-4a1a-984e-ab10a4973650 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.357153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bef710-78ef-4a1a-984e-ab10a4973650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:54.357153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bef710-78ef-4a1a-984e-ab10a4973650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:54.358675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bef710-78ef-4a1a-984e-ab10a4973650 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:54.371724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 906/1832] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:25:54.376073 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64145d07-9a21-40d6-879d-83095517e082 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:54.386276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64145d07-9a21-40d6-879d-83095517e082 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:54.391122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e924e-f41c-47af-adf0-428675605360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:54.391739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e924e-f41c-47af-adf0-428675605360 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.392015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e924e-f41c-47af-adf0-428675605360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.392281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e924e-f41c-47af-adf0-428675605360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.393061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e924e-f41c-47af-adf0-428675605360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:54.395004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e924e-f41c-47af-adf0-428675605360 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:54.482712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 927/1833] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:54 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:54.486944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bef710-78ef-4a1a-984e-ab10a4973650 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:54.498088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bef710-78ef-4a1a-984e-ab10a4973650 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:54.578245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d00ae5-b126-48a4-a2d7-c8210bf9bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:54.578918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d00ae5-b126-48a4-a2d7-c8210bf9bebf admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.579292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d00ae5-b126-48a4-a2d7-c8210bf9bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.579469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d00ae5-b126-48a4-a2d7-c8210bf9bebf admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.580846 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d00ae5-b126-48a4-a2d7-c8210bf9bebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:54.584289 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d00ae5-b126-48a4-a2d7-c8210bf9bebf admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:54.587532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e924e-f41c-47af-adf0-428675605360 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:54.589531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-851e924e-f41c-47af-adf0-428675605360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:54.654146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e924e-f41c-47af-adf0-428675605360 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:54.669245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf4cbd-f520-428b-80ea-fad5f4d64b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:54.669886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4cbd-f520-428b-80ea-fad5f4d64b2f service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.670160 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4cbd-f520-428b-80ea-fad5f4d64b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.670479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4cbd-f520-428b-80ea-fad5f4d64b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.672297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-31bf4cbd-f520-428b-80ea-fad5f4d64b2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:54.706050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 907/1834] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:54 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:54.708272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d00ae5-b126-48a4-a2d7-c8210bf9bebf admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:54.722548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d00ae5-b126-48a4-a2d7-c8210bf9bebf admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:54.727651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece6673-f656-45b6-9a6a-c45c5ce18313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:54.728436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6673-f656-45b6-9a6a-c45c5ce18313 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.728712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6673-f656-45b6-9a6a-c45c5ce18313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.729890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6673-f656-45b6-9a6a-c45c5ce18313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.730833 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece6673-f656-45b6-9a6a-c45c5ce18313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:54.733031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece6673-f656-45b6-9a6a-c45c5ce18313 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:54.763783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 908/1835] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:54.764724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece6673-f656-45b6-9a6a-c45c5ce18313 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:54.770162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf4cbd-f520-428b-80ea-fad5f4d64b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:54.771587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf4cbd-f520-428b-80ea-fad5f4d64b2f service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:54.783308 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece6673-f656-45b6-9a6a-c45c5ce18313 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:54.784327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 928/1836] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:25:54.797875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd0710-4653-4ce5-b5fb-312aa9604811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:54.798589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd0710-4653-4ce5-b5fb-312aa9604811 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.799098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd0710-4653-4ce5-b5fb-312aa9604811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.799375 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd0710-4653-4ce5-b5fb-312aa9604811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.800469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd0710-4653-4ce5-b5fb-312aa9604811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:54.801881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd0710-4653-4ce5-b5fb-312aa9604811 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:54.816996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 909/1837] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:54.823276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf4cbd-f520-428b-80ea-fad5f4d64b2f service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:54.840855 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf4cbd-f520-428b-80ea-fad5f4d64b2f service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:54.846134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89804efe-9e39-4045-816f-ec13b1e8898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:54.846866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89804efe-9e39-4045-816f-ec13b1e8898c admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.847143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89804efe-9e39-4045-816f-ec13b1e8898c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.847413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89804efe-9e39-4045-816f-ec13b1e8898c admin admin] PATH_INFO: `/v3/projects/98ae3f16571b4561a7debdaad2dbd692/users/b9599b91d3474976afd6e9802c93b48d/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:54.866811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89804efe-9e39-4045-816f-ec13b1e8898c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ae3f16571b4561a7debdaad2dbd692, user_id=b9599b91d3474976afd6e9802c93b48d, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:54.869554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89804efe-9e39-4045-816f-ec13b1e8898c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:54.953902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 929/1838] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:54 2022] PUT /identity/v3/projects/98ae3f16571b4561a7debdaad2dbd692/users/b9599b91d3474976afd6e9802c93b48d/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:54.967049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b5cc3-d3dc-4a88-b847-c1ff5bf14c0b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:54.967049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b5cc3-d3dc-4a88-b847-c1ff5bf14c0b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:54.967049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b5cc3-d3dc-4a88-b847-c1ff5bf14c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:55.002922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8a6b5cc3-d3dc-4a88-b847-c1ff5bf14c0b None None] MFA Rules not processed for user `b9599b91d3474976afd6e9802c93b48d`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:55.008280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8a6b5cc3-d3dc-4a88-b847-c1ff5bf14c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:55.041531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:55.095495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 910/1839] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:55.102030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89804efe-9e39-4045-816f-ec13b1e8898c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:55.170763 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89804efe-9e39-4045-816f-ec13b1e8898c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:55.175812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b0575-a35d-4b4b-a966-8ef91d714304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:55.176499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b0575-a35d-4b4b-a966-8ef91d714304 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:55.176840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b0575-a35d-4b4b-a966-8ef91d714304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:55.177108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b0575-a35d-4b4b-a966-8ef91d714304 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:55.177781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b0575-a35d-4b4b-a966-8ef91d714304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:55.179701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b0575-a35d-4b4b-a966-8ef91d714304 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:55.326488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:55.385290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 930/1840] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:55 2022] POST /identity/v3/projects => generated 381 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:55.392034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b5cc3-d3dc-4a88-b847-c1ff5bf14c0b None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:55.403101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b5cc3-d3dc-4a88-b847-c1ff5bf14c0b None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:55.464715 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec910d5-c70e-4d1e-8b1e-1d26446b3d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:55.465340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec910d5-c70e-4d1e-8b1e-1d26446b3d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:55.465612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec910d5-c70e-4d1e-8b1e-1d26446b3d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:55.465887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec910d5-c70e-4d1e-8b1e-1d26446b3d22 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:55.466669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec910d5-c70e-4d1e-8b1e-1d26446b3d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:55.477772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec910d5-c70e-4d1e-8b1e-1d26446b3d22 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:55.603925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 911/1841] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:55 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:55.606637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b0575-a35d-4b4b-a966-8ef91d714304 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:55.617574 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b0575-a35d-4b4b-a966-8ef91d714304 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:55.625377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08a2e5-5175-43d1-a65b-38a972977267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:55.626683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08a2e5-5175-43d1-a65b-38a972977267 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:55.631887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08a2e5-5175-43d1-a65b-38a972977267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:55.631887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08a2e5-5175-43d1-a65b-38a972977267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:55.631887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08a2e5-5175-43d1-a65b-38a972977267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:55.631887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08a2e5-5175-43d1-a65b-38a972977267 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:55.643544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 931/1842] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:55.652606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec910d5-c70e-4d1e-8b1e-1d26446b3d22 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:55.664689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec910d5-c70e-4d1e-8b1e-1d26446b3d22 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:55.671033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98dc11-7d43-4a57-80cb-4d39636ec16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:55.671719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98dc11-7d43-4a57-80cb-4d39636ec16b admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:55.672004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98dc11-7d43-4a57-80cb-4d39636ec16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:55.672275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98dc11-7d43-4a57-80cb-4d39636ec16b admin admin] PATH_INFO: `/v3/projects/c54745efddfb4249ab9449a4784bc915/users/6cc83b51595a473ab974553ff20d3cb3/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:55.695393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98dc11-7d43-4a57-80cb-4d39636ec16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54745efddfb4249ab9449a4784bc915, user_id=6cc83b51595a473ab974553ff20d3cb3, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:55.699070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98dc11-7d43-4a57-80cb-4d39636ec16b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:55.778769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 912/1843] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:55 2022] PUT /identity/v3/projects/c54745efddfb4249ab9449a4784bc915/users/6cc83b51595a473ab974553ff20d3cb3/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:55.782879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08a2e5-5175-43d1-a65b-38a972977267 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:55.794254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08a2e5-5175-43d1-a65b-38a972977267 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:55.867715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d6524-3d5e-40dd-9370-0f96ce5266d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:55.868762 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d6524-3d5e-40dd-9370-0f96ce5266d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:55.869191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d6524-3d5e-40dd-9370-0f96ce5266d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:55.869613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d6524-3d5e-40dd-9370-0f96ce5266d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:55.871002 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d6524-3d5e-40dd-9370-0f96ce5266d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:55.873081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d6524-3d5e-40dd-9370-0f96ce5266d2 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:55.888486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 932/1844] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:55.892969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98dc11-7d43-4a57-80cb-4d39636ec16b admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:55.904927 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98dc11-7d43-4a57-80cb-4d39636ec16b admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:55.910357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747b6ac-05aa-42f6-bbb2-35d85f2059cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:55.917720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747b6ac-05aa-42f6-bbb2-35d85f2059cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:55.917720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747b6ac-05aa-42f6-bbb2-35d85f2059cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:55.917720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747b6ac-05aa-42f6-bbb2-35d85f2059cc admin admin] PATH_INFO: `/v3/projects/c54745efddfb4249ab9449a4784bc915/users/6cc83b51595a473ab974553ff20d3cb3/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:55.917720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747b6ac-05aa-42f6-bbb2-35d85f2059cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54745efddfb4249ab9449a4784bc915, user_id=6cc83b51595a473ab974553ff20d3cb3, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:55.924214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747b6ac-05aa-42f6-bbb2-35d85f2059cc admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:55.937631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:55.938603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 913/1845] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:55 2022] PUT /identity/v3/projects/c54745efddfb4249ab9449a4784bc915/users/6cc83b51595a473ab974553ff20d3cb3/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:55.950226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49416c60-ac30-41ef-b412-4f7b63599de1 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:55.950535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49416c60-ac30-41ef-b412-4f7b63599de1 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:55.950815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49416c60-ac30-41ef-b412-4f7b63599de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:55.990457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-49416c60-ac30-41ef-b412-4f7b63599de1 None None] MFA Rules not processed for user `6cc83b51595a473ab974553ff20d3cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:55.991241 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-49416c60-ac30-41ef-b412-4f7b63599de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:56.023428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:56.098235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 933/1846] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:56.112495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747b6ac-05aa-42f6-bbb2-35d85f2059cc admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:56.177656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747b6ac-05aa-42f6-bbb2-35d85f2059cc admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:56.181587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c33f3a-52e7-4142-89bb-879acf5b8ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:56.182225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c33f3a-52e7-4142-89bb-879acf5b8ccb service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:56.183313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c33f3a-52e7-4142-89bb-879acf5b8ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:56.190938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c33f3a-52e7-4142-89bb-879acf5b8ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:56.193892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c33f3a-52e7-4142-89bb-879acf5b8ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:56.195490 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c33f3a-52e7-4142-89bb-879acf5b8ccb service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:56.206819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 914/1847] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:56.343419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:56.417694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:56.857670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:57.223733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:57.303123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:57.341981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49416c60-ac30-41ef-b412-4f7b63599de1 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:57.352209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49416c60-ac30-41ef-b412-4f7b63599de1 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:57.357984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc63631-2a72-4197-aa7f-36a638dc3d8a tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc83b51595a473ab974553ff20d3cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54745efddfb4249ab9449a4784bc915', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:57.358795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63631-2a72-4197-aa7f-36a638dc3d8a tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:57.359135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63631-2a72-4197-aa7f-36a638dc3d8a tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:57.359482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63631-2a72-4197-aa7f-36a638dc3d8a tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:57.360271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc63631-2a72-4197-aa7f-36a638dc3d8a tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:57.360777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc63631-2a72-4197-aa7f-36a638dc3d8a tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:57.362450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc63631-2a72-4197-aa7f-36a638dc3d8a tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:57.382737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 934/1848] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:25:57.382920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c33f3a-52e7-4142-89bb-879acf5b8ccb service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:57.393211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c33f3a-52e7-4142-89bb-879acf5b8ccb service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:57.398550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997fbf-9100-4619-99f0-c777892c69dd tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc83b51595a473ab974553ff20d3cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54745efddfb4249ab9449a4784bc915', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:57.399176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997fbf-9100-4619-99f0-c777892c69dd tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:57.399450 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997fbf-9100-4619-99f0-c777892c69dd tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:57.399733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997fbf-9100-4619-99f0-c777892c69dd tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:57.400391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74997fbf-9100-4619-99f0-c777892c69dd tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:57.402826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74997fbf-9100-4619-99f0-c777892c69dd tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:57.471411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 915/1849] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:57 2022] POST /identity/v3/projects => generated 354 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:57.475685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc63631-2a72-4197-aa7f-36a638dc3d8a tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:57.486652 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc63631-2a72-4197-aa7f-36a638dc3d8a tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:57.547454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77803c-bf83-408e-ac77-db0c41c8451f tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc83b51595a473ab974553ff20d3cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54745efddfb4249ab9449a4784bc915', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:57.548074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77803c-bf83-408e-ac77-db0c41c8451f tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:57.548355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77803c-bf83-408e-ac77-db0c41c8451f tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:57.548627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77803c-bf83-408e-ac77-db0c41c8451f tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:57.549322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77803c-bf83-408e-ac77-db0c41c8451f tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:57.549628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77803c-bf83-408e-ac77-db0c41c8451f tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:57.552021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77803c-bf83-408e-ac77-db0c41c8451f tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:57.565350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 935/1850] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:25:57.611063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997fbf-9100-4619-99f0-c777892c69dd tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:57.617525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:57.622364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997fbf-9100-4619-99f0-c777892c69dd tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:57.627234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc83b51595a473ab974553ff20d3cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54745efddfb4249ab9449a4784bc915', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:57.627767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:57.628571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:57.628571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] PATH_INFO: `/v3/projects/9b0ae5e841814a9ab898d93505158dad` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:57.629478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b0ae5e841814a9ab898d93505158dad)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:57.631433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:57.753616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:57.754302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:57.762563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0ae5e841814a9ab898d93505158dad', 'request_id': 'req-205f93da-c096-45e6-a223-cc3255cfa290'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:57.768846 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0ae5e841814a9ab898d93505158dad', 'request_id': 'req-205f93da-c096-45e6-a223-cc3255cfa290'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:57.840766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0ae5e841814a9ab898d93505158dad', 'request_id': 'req-205f93da-c096-45e6-a223-cc3255cfa290'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:57.851505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] The token cache is being invalidate because project 9b0ae5e841814a9ab898d93505158dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:57.855705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:57.855705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-205f93da-c096-45e6-a223-cc3255cfa290 tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:57.855705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 916/1851] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:57 2022] DELETE /identity/v3/projects/9b0ae5e841814a9ab898d93505158dad => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:58.645209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77803c-bf83-408e-ac77-db0c41c8451f tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:58.647198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-eb77803c-bf83-408e-ac77-db0c41c8451f tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:58.672873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:58.725313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77803c-bf83-408e-ac77-db0c41c8451f tempest-VolumeQuotaClassesTest-1648422461 tempest-VolumeQuotaClassesTest-1648422461-project-admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:58.784506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:58.785404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:58.785702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:58.786009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] PATH_INFO: `/v3/users/b9599b91d3474976afd6e9802c93b48d` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:58.787172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9599b91d3474976afd6e9802c93b48d)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:58.789077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:58.957687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9599b91d3474976afd6e9802c93b48d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:58.958276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9599b91d3474976afd6e9802c93b48d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:58.967493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9599b91d3474976afd6e9802c93b48d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:58.981015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9599b91d3474976afd6e9802c93b48d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:59.040236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9599b91d3474976afd6e9802c93b48d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:59.049222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 936/1852] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:58 2022] DELETE /identity/v3/users/b9599b91d3474976afd6e9802c93b48d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:59.054124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92c2b-b575-459d-9d1b-794480c2958d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:59.054684 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92c2b-b575-459d-9d1b-794480c2958d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:59.054832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92c2b-b575-459d-9d1b-794480c2958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:59.076696 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e3d92c2b-b575-459d-9d1b-794480c2958d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:59.078065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e3d92c2b-b575-459d-9d1b-794480c2958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:59.151116 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 917/1853] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:59.161453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:59.163407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:59.238747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:59.244319 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca77030-ee3b-4d96-a783-710eb7ed5116 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:59.249377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cddffa-53bd-48cf-b5fe-4083c2b5b065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:59.250049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cddffa-53bd-48cf-b5fe-4083c2b5b065 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:59.250353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cddffa-53bd-48cf-b5fe-4083c2b5b065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:59.250622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cddffa-53bd-48cf-b5fe-4083c2b5b065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:59.261725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cddffa-53bd-48cf-b5fe-4083c2b5b065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:59.263270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cddffa-53bd-48cf-b5fe-4083c2b5b065 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:59.273871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 937/1854] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:25:59.927295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d92c2b-b575-459d-9d1b-794480c2958d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:59.928808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e3d92c2b-b575-459d-9d1b-794480c2958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:59.944813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d92c2b-b575-459d-9d1b-794480c2958d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:59.950854 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:59.952167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:59.952527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:59.952807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] PATH_INFO: `/v3/projects/98ae3f16571b4561a7debdaad2dbd692` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:59.954190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ae3f16571b4561a7debdaad2dbd692)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:59.956890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:00.080737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ae3f16571b4561a7debdaad2dbd692', 'request_id': 'req-a8495515-b01d-4fb1-a7ec-78b04c9b422c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.086914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ae3f16571b4561a7debdaad2dbd692', 'request_id': 'req-a8495515-b01d-4fb1-a7ec-78b04c9b422c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.205326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ae3f16571b4561a7debdaad2dbd692', 'request_id': 'req-a8495515-b01d-4fb1-a7ec-78b04c9b422c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.224560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] The token cache is being invalidate because project 98ae3f16571b4561a7debdaad2dbd692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:00.225084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.226075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.228206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 918/1855] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:59 2022] DELETE /identity/v3/projects/98ae3f16571b4561a7debdaad2dbd692 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:00.237687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cddffa-53bd-48cf-b5fe-4083c2b5b065 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:00.240245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:00.242097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:00.257592 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cddffa-53bd-48cf-b5fe-4083c2b5b065 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:00.329256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:00.341989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:00.358599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:00.358599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:00.358599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] PATH_INFO: `/v3/users/6cc83b51595a473ab974553ff20d3cb3` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:00.358599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc83b51595a473ab974553ff20d3cb3)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:00.360429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495515-b01d-4fb1-a7ec-78b04c9b422c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:00.360586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:00.377460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:00.378916 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:00.379269 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:00.379763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] PATH_INFO: `/v3/users/444a2fdad38a4c6abac8dacc0729820c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:00.382223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=444a2fdad38a4c6abac8dacc0729820c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:00.387255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:00.565532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc83b51595a473ab974553ff20d3cb3'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.566455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc83b51595a473ab974553ff20d3cb3'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.577812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc83b51595a473ab974553ff20d3cb3'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.600111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc83b51595a473ab974553ff20d3cb3'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.635351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '444a2fdad38a4c6abac8dacc0729820c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.636187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '444a2fdad38a4c6abac8dacc0729820c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.645596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '444a2fdad38a4c6abac8dacc0729820c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.647050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '444a2fdad38a4c6abac8dacc0729820c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.721590 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-1fcbbf5c-008b-41e1-b9b8-7c16c31274c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc83b51595a473ab974553ff20d3cb3'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.728744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 938/1856] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:00 2022] DELETE /identity/v3/users/6cc83b51595a473ab974553ff20d3cb3 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:00.817582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '444a2fdad38a4c6abac8dacc0729820c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:00.862481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 919/1857] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:00 2022] DELETE /identity/v3/users/444a2fdad38a4c6abac8dacc0729820c => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:00.864601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82012b-8f1e-4a7e-a347-bf8db758df95 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:00.865432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82012b-8f1e-4a7e-a347-bf8db758df95 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:00.865432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82012b-8f1e-4a7e-a347-bf8db758df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:00.903711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3e82012b-8f1e-4a7e-a347-bf8db758df95 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:00.905272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3e82012b-8f1e-4a7e-a347-bf8db758df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:01.046134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 939/1858] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:01.056857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:01.059235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:01.131229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8029ed-1a47-4e0a-981a-f380529974cc admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:01.139143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc76cd-b832-441d-8bba-fa206bfa71c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:01.140175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc76cd-b832-441d-8bba-fa206bfa71c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:01.140452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc76cd-b832-441d-8bba-fa206bfa71c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:01.140796 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc76cd-b832-441d-8bba-fa206bfa71c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:01.166551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc76cd-b832-441d-8bba-fa206bfa71c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:01.168716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc76cd-b832-441d-8bba-fa206bfa71c0 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:01.180931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 920/1859] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:01.391422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82012b-8f1e-4a7e-a347-bf8db758df95 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:01.393029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3e82012b-8f1e-4a7e-a347-bf8db758df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:01.415345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82012b-8f1e-4a7e-a347-bf8db758df95 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:01.429880 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:01.430735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:01.431083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:01.439180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] PATH_INFO: `/v3/projects/c54745efddfb4249ab9449a4784bc915` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:01.440606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54745efddfb4249ab9449a4784bc915)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:01.442687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:01.445576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:01.630523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54745efddfb4249ab9449a4784bc915', 'request_id': 'req-df216471-d285-459b-8fe2-c79954b351b3'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:01.637017 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54745efddfb4249ab9449a4784bc915', 'request_id': 'req-df216471-d285-459b-8fe2-c79954b351b3'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:01.733202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54745efddfb4249ab9449a4784bc915', 'request_id': 'req-df216471-d285-459b-8fe2-c79954b351b3'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:01.744659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc76cd-b832-441d-8bba-fa206bfa71c0 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:01.746544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-61dc76cd-b832-441d-8bba-fa206bfa71c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:01.757186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] The token cache is being invalidate because project c54745efddfb4249ab9449a4784bc915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:01.757484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:01.759111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-df216471-d285-459b-8fe2-c79954b351b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:01.761400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 940/1860] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:01 2022] DELETE /identity/v3/projects/c54745efddfb4249ab9449a4784bc915 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:01.764637 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc76cd-b832-441d-8bba-fa206bfa71c0 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:01.768066 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddc84f-d7db-4dac-be43-5fac58b86a12 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:01.768396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddc84f-d7db-4dac-be43-5fac58b86a12 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:01.768726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddc84f-d7db-4dac-be43-5fac58b86a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:01.793134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-81ddc84f-d7db-4dac-be43-5fac58b86a12 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:01.793844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-81ddc84f-d7db-4dac-be43-5fac58b86a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:01.829999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:01.830596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:01.830886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:01.831164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] PATH_INFO: `/v3/projects/ae24a99d793d464183d8c7657f334029` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:01.832344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae24a99d793d464183d8c7657f334029)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:01.834290 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:01.847306 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:01.860268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 941/1861] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:01.868854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a4d5-2009-48d7-adc4-c86da0ebcba5 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:01.869054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a4d5-2009-48d7-adc4-c86da0ebcba5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:01.869272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a4d5-2009-48d7-adc4-c86da0ebcba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:01.890228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0a95a4d5-2009-48d7-adc4-c86da0ebcba5 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:01.891509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0a95a4d5-2009-48d7-adc4-c86da0ebcba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:01.899708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 942/1862] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:01.904423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95a4d5-2009-48d7-adc4-c86da0ebcba5 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:01.915706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95a4d5-2009-48d7-adc4-c86da0ebcba5 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:01.920638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081e953-e0ca-4479-96c0-e34ffa62c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:01.921262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e953-e0ca-4479-96c0-e34ffa62c05c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:01.921542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e953-e0ca-4479-96c0-e34ffa62c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:01.921816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e953-e0ca-4479-96c0-e34ffa62c05c admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:01.922552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081e953-e0ca-4479-96c0-e34ffa62c05c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:01.922853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081e953-e0ca-4479-96c0-e34ffa62c05c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:01.924484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081e953-e0ca-4479-96c0-e34ffa62c05c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:01.939473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 943/1863] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:26:01.943939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081e953-e0ca-4479-96c0-e34ffa62c05c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:01.955548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081e953-e0ca-4479-96c0-e34ffa62c05c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:01.956635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae24a99d793d464183d8c7657f334029', 'request_id': 'req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:01.965195 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae24a99d793d464183d8c7657f334029', 'request_id': 'req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:02.018178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af04c-a96a-4b5b-87bf-c822d60a51a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:02.018848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af04c-a96a-4b5b-87bf-c822d60a51a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:02.019109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af04c-a96a-4b5b-87bf-c822d60a51a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:02.019377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af04c-a96a-4b5b-87bf-c822d60a51a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:02.020032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1af04c-a96a-4b5b-87bf-c822d60a51a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:02.022046 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1af04c-a96a-4b5b-87bf-c822d60a51a7 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:02.066153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae24a99d793d464183d8c7657f334029', 'request_id': 'req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:02.078110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] The token cache is being invalidate because project ae24a99d793d464183d8c7657f334029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:02.078435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:02.079313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:02.081015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 921/1864] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:01 2022] DELETE /identity/v3/projects/ae24a99d793d464183d8c7657f334029 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:02.084978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:02.086297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:02.100678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c6029-0ddd-4afb-8b0d-aac2ddc2e8da admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:02.105361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:02.106061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:02.106369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:02.106652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] PATH_INFO: `/v3/users/f4880c9970e14533af8f4cc1bca82c52` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:02.108541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4880c9970e14533af8f4cc1bca82c52)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:02.110769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:02.138266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:02.145898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 944/1865] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:01 2022] POST /identity/v3/projects => generated 393 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:02.159311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af04c-a96a-4b5b-87bf-c822d60a51a7 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:02.161519 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8d1af04c-a96a-4b5b-87bf-c822d60a51a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:02.247881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af04c-a96a-4b5b-87bf-c822d60a51a7 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:02.266607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076c5e-49a4-4a56-abd5-89b04e05a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:02.267502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076c5e-49a4-4a56-abd5-89b04e05a163 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:02.268038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076c5e-49a4-4a56-abd5-89b04e05a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:02.268504 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b076c5e-49a4-4a56-abd5-89b04e05a163 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:02.269405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b076c5e-49a4-4a56-abd5-89b04e05a163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:02.271509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b076c5e-49a4-4a56-abd5-89b04e05a163 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:02.442689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4880c9970e14533af8f4cc1bca82c52'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:02.443569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4880c9970e14533af8f4cc1bca82c52'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:02.451400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4880c9970e14533af8f4cc1bca82c52'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:02.452051 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4880c9970e14533af8f4cc1bca82c52'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:02.506473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 945/1866] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:02 2022] POST /identity/v3/users => generated 297 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:02.506473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076c5e-49a4-4a56-abd5-89b04e05a163 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:02.506473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7b076c5e-49a4-4a56-abd5-89b04e05a163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:02.517398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b076c5e-49a4-4a56-abd5-89b04e05a163 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:02.522822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83a4c3-892c-4f8f-bd07-83a83822d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:02.523439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83a4c3-892c-4f8f-bd07-83a83822d2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:02.523778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83a4c3-892c-4f8f-bd07-83a83822d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:02.524052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83a4c3-892c-4f8f-bd07-83a83822d2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:02.524778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83a4c3-892c-4f8f-bd07-83a83822d2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:02.527040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83a4c3-892c-4f8f-bd07-83a83822d2f7 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:02.539123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 946/1867] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:02.552704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83a4c3-892c-4f8f-bd07-83a83822d2f7 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:02.563587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83a4c3-892c-4f8f-bd07-83a83822d2f7 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:02.569905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b89245-6fcd-40e1-a170-2f0677064cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:02.572173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b89245-6fcd-40e1-a170-2f0677064cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:02.572173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b89245-6fcd-40e1-a170-2f0677064cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:02.572173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b89245-6fcd-40e1-a170-2f0677064cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:02.572173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b89245-6fcd-40e1-a170-2f0677064cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:02.574265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b89245-6fcd-40e1-a170-2f0677064cc6 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:02.593587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 947/1868] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:02.593820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d274801d-d9c0-4d3f-8a25-2c81d75ef4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4880c9970e14533af8f4cc1bca82c52'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:02.595511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b89245-6fcd-40e1-a170-2f0677064cc6 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:02.609125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b89245-6fcd-40e1-a170-2f0677064cc6 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:02.617350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac900-c7b2-4911-9586-df02c709fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:02.622479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac900-c7b2-4911-9586-df02c709fae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:02.622479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac900-c7b2-4911-9586-df02c709fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:02.622479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac900-c7b2-4911-9586-df02c709fae1 admin admin] PATH_INFO: `/v3/projects/cbc604885a1d428ba051606e2ba036a8/users/b804b27e1362465b8be1c94a884c5eb7/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:02.634150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 922/1869] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:02 2022] DELETE /identity/v3/users/f4880c9970e14533af8f4cc1bca82c52 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:02.638115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac900-c7b2-4911-9586-df02c709fae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc604885a1d428ba051606e2ba036a8, user_id=b804b27e1362465b8be1c94a884c5eb7, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:02.640921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac900-c7b2-4911-9586-df02c709fae1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:02.826547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 948/1870] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:02 2022] PUT /identity/v3/projects/cbc604885a1d428ba051606e2ba036a8/users/b804b27e1362465b8be1c94a884c5eb7/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:02.839200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92f0a-3dee-4d40-8402-a3227e8b82ee None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:02.839678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92f0a-3dee-4d40-8402-a3227e8b82ee None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:02.840429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92f0a-3dee-4d40-8402-a3227e8b82ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:02.874227 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-0fa92f0a-3dee-4d40-8402-a3227e8b82ee None None] MFA Rules not processed for user `b804b27e1362465b8be1c94a884c5eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:02.876174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0fa92f0a-3dee-4d40-8402-a3227e8b82ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:02.971113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 923/1871] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:02.972262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac900-c7b2-4911-9586-df02c709fae1 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:03.059817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac900-c7b2-4911-9586-df02c709fae1 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:03.064672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03e83-cfc9-4a68-81e9-8b699e1d39e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:03.070499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03e83-cfc9-4a68-81e9-8b699e1d39e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.070499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03e83-cfc9-4a68-81e9-8b699e1d39e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.070499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03e83-cfc9-4a68-81e9-8b699e1d39e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.070499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03e83-cfc9-4a68-81e9-8b699e1d39e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:03.070499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03e83-cfc9-4a68-81e9-8b699e1d39e9 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:03.094019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92f0a-3dee-4d40-8402-a3227e8b82ee None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:03.095503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0fa92f0a-3dee-4d40-8402-a3227e8b82ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:03.104569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:03.111046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92f0a-3dee-4d40-8402-a3227e8b82ee None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:03.116264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:03.116920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.117198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.119203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] PATH_INFO: `/v3/projects/f5659f9473964cc2af4362b091b8adde` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.119339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5659f9473964cc2af4362b091b8adde)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:03.126546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:03.197777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 949/1872] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:02 2022] POST /identity/v3/projects => generated 393 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:03.208204 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03e83-cfc9-4a68-81e9-8b699e1d39e9 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:03.238655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:03.271920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5659f9473964cc2af4362b091b8adde', 'request_id': 'req-4081f4e5-714a-465b-b40a-ae1596f98656'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:03.276039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03e83-cfc9-4a68-81e9-8b699e1d39e9 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:03.280305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5659f9473964cc2af4362b091b8adde', 'request_id': 'req-4081f4e5-714a-465b-b40a-ae1596f98656'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:03.335406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf2329-b922-437f-b813-b756c79389fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:03.336069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2329-b922-437f-b813-b756c79389fd admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.336343 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2329-b922-437f-b813-b756c79389fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.336608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2329-b922-437f-b813-b756c79389fd admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.337273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf2329-b922-437f-b813-b756c79389fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:03.339389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf2329-b922-437f-b813-b756c79389fd admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:03.463073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5659f9473964cc2af4362b091b8adde', 'request_id': 'req-4081f4e5-714a-465b-b40a-ae1596f98656'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:03.475380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] The token cache is being invalidate because project f5659f9473964cc2af4362b091b8adde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:03.475796 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:03.476519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4081f4e5-714a-465b-b40a-ae1596f98656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:03.478223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 924/1873] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:03 2022] DELETE /identity/v3/projects/f5659f9473964cc2af4362b091b8adde => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:03.483581 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355dc97-cdbb-4ded-ac0b-8859da74e37b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.483895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355dc97-cdbb-4ded-ac0b-8859da74e37b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.484213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355dc97-cdbb-4ded-ac0b-8859da74e37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.498849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 950/1874] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:03 2022] POST /identity/v3/users => generated 303 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:03.504122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf2329-b922-437f-b813-b756c79389fd admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:03.506058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5ccf2329-b922-437f-b813-b756c79389fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:03.516070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-2355dc97-cdbb-4ded-ac0b-8859da74e37b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:03.520156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2355dc97-cdbb-4ded-ac0b-8859da74e37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:03.520247 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf2329-b922-437f-b813-b756c79389fd admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:03.530626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4167d-e26a-4490-a6f4-0364681ce60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:03.530626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4167d-e26a-4490-a6f4-0364681ce60a admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.530626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4167d-e26a-4490-a6f4-0364681ce60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.530626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4167d-e26a-4490-a6f4-0364681ce60a admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.530912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4167d-e26a-4490-a6f4-0364681ce60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:03.530979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 925/1875] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:03.531050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4167d-e26a-4490-a6f4-0364681ce60a admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:03.538233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2165e7-3988-4b75-a5e8-a11895407e62 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.538687 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2165e7-3988-4b75-a5e8-a11895407e62 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.539620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2165e7-3988-4b75-a5e8-a11895407e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.544217 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 951/1876] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:03.547966 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4167d-e26a-4490-a6f4-0364681ce60a admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:03.564178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-cb2165e7-3988-4b75-a5e8-a11895407e62 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:03.564849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4167d-e26a-4490-a6f4-0364681ce60a admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:03.565516 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cb2165e7-3988-4b75-a5e8-a11895407e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:03.570782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d42e1-8bb6-4ae2-9774-55f158d4c495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:03.571612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d42e1-8bb6-4ae2-9774-55f158d4c495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.572041 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d42e1-8bb6-4ae2-9774-55f158d4c495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.572403 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d42e1-8bb6-4ae2-9774-55f158d4c495 admin admin] PATH_INFO: `/v3/projects/54107a78c3a24967845f3683446aee45/users/9f8f4b15264746ffac6dfa0d321b49a4/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.587140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 926/1877] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:03.587140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2165e7-3988-4b75-a5e8-a11895407e62 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:03.591620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2165e7-3988-4b75-a5e8-a11895407e62 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:03.593669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d42e1-8bb6-4ae2-9774-55f158d4c495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54107a78c3a24967845f3683446aee45, user_id=9f8f4b15264746ffac6dfa0d321b49a4, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:03.596313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d42e1-8bb6-4ae2-9774-55f158d4c495 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:03.596424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad600-1711-4c8a-87f1-bf00dcf67c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:03.597132 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad600-1711-4c8a-87f1-bf00dcf67c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.597478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad600-1711-4c8a-87f1-bf00dcf67c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.597818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bad600-1711-4c8a-87f1-bf00dcf67c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.598656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bad600-1711-4c8a-87f1-bf00dcf67c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:03.599042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bad600-1711-4c8a-87f1-bf00dcf67c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:03.600685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bad600-1711-4c8a-87f1-bf00dcf67c18 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:03.613112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 927/1878] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:26:03.618900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad600-1711-4c8a-87f1-bf00dcf67c18 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:03.629123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bad600-1711-4c8a-87f1-bf00dcf67c18 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:03.634364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4328d2-5b67-4402-8fd5-a4076e2cd2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:03.634975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4328d2-5b67-4402-8fd5-a4076e2cd2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.635253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4328d2-5b67-4402-8fd5-a4076e2cd2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.635571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4328d2-5b67-4402-8fd5-a4076e2cd2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.636305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4328d2-5b67-4402-8fd5-a4076e2cd2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:03.638109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4328d2-5b67-4402-8fd5-a4076e2cd2f3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:03.709270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 952/1879] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:03 2022] PUT /identity/v3/projects/54107a78c3a24967845f3683446aee45/users/9f8f4b15264746ffac6dfa0d321b49a4/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:03.713232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d42e1-8bb6-4ae2-9774-55f158d4c495 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:03.759880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 928/1880] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:03 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:03.761764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4328d2-5b67-4402-8fd5-a4076e2cd2f3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:03.789673 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d42e1-8bb6-4ae2-9774-55f158d4c495 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:03.842341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:03.846527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4328d2-5b67-4402-8fd5-a4076e2cd2f3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:03.850743 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c45a03-9c26-44e4-86e6-a4c125f6dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:03.851361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c45a03-9c26-44e4-86e6-a4c125f6dbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.851683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c45a03-9c26-44e4-86e6-a4c125f6dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.851975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c45a03-9c26-44e4-86e6-a4c125f6dbb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.852690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c45a03-9c26-44e4-86e6-a4c125f6dbb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:03.855101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c45a03-9c26-44e4-86e6-a4c125f6dbb4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:03.868786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4094e0c-8426-4743-9b49-ad20979d4c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:03.869410 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4094e0c-8426-4743-9b49-ad20979d4c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.869705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4094e0c-8426-4743-9b49-ad20979d4c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.870514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4094e0c-8426-4743-9b49-ad20979d4c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.871767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4094e0c-8426-4743-9b49-ad20979d4c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:03.872787 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4094e0c-8426-4743-9b49-ad20979d4c16 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:03.882537 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 953/1881] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:03.888353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4094e0c-8426-4743-9b49-ad20979d4c16 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:03.899085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4094e0c-8426-4743-9b49-ad20979d4c16 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:03.903654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e9bfe-d838-4c13-8722-d90ad50441e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:03.904307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9bfe-d838-4c13-8722-d90ad50441e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.904583 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9bfe-d838-4c13-8722-d90ad50441e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.904855 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9bfe-d838-4c13-8722-d90ad50441e6 admin admin] PATH_INFO: `/v3/projects/54107a78c3a24967845f3683446aee45/users/9f8f4b15264746ffac6dfa0d321b49a4/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.907025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e9bfe-d838-4c13-8722-d90ad50441e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54107a78c3a24967845f3683446aee45, user_id=9f8f4b15264746ffac6dfa0d321b49a4, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:03.909467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e9bfe-d838-4c13-8722-d90ad50441e6 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:03.921544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 954/1882] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:03 2022] PUT /identity/v3/projects/54107a78c3a24967845f3683446aee45/users/9f8f4b15264746ffac6dfa0d321b49a4/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:03.933686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54676d2-550d-472d-92d8-8b02cab22931 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:03.933966 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54676d2-550d-472d-92d8-8b02cab22931 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:03.934236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54676d2-550d-472d-92d8-8b02cab22931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:03.965433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a54676d2-550d-472d-92d8-8b02cab22931 None None] MFA Rules not processed for user `9f8f4b15264746ffac6dfa0d321b49a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:03.966727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a54676d2-550d-472d-92d8-8b02cab22931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:03.984069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 929/1883] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:03 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:03.990479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c45a03-9c26-44e4-86e6-a4c125f6dbb4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:04.013746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c45a03-9c26-44e4-86e6-a4c125f6dbb4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:04.047360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:04.064078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 955/1884] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:04.080044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54676d2-550d-472d-92d8-8b02cab22931 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:04.081990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a54676d2-550d-472d-92d8-8b02cab22931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:04.091026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8c6a0-3cb5-4b43-a83e-448242404ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:04.091764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8c6a0-3cb5-4b43-a83e-448242404ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:04.091944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8c6a0-3cb5-4b43-a83e-448242404ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:04.092219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8c6a0-3cb5-4b43-a83e-448242404ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:04.092928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8c6a0-3cb5-4b43-a83e-448242404ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:04.094577 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8c6a0-3cb5-4b43-a83e-448242404ac8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:04.106686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 930/1885] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:04.112994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8c6a0-3cb5-4b43-a83e-448242404ac8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:04.125710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8c6a0-3cb5-4b43-a83e-448242404ac8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:04.131181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc431b79-8bb2-4e6d-904a-089ceb06d31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:04.131816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc431b79-8bb2-4e6d-904a-089ceb06d31b admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:04.132458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc431b79-8bb2-4e6d-904a-089ceb06d31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:04.132749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc431b79-8bb2-4e6d-904a-089ceb06d31b admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:04.133461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc431b79-8bb2-4e6d-904a-089ceb06d31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:04.135252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc431b79-8bb2-4e6d-904a-089ceb06d31b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:04.148321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 931/1886] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:04.153624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc431b79-8bb2-4e6d-904a-089ceb06d31b admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:04.171295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc431b79-8bb2-4e6d-904a-089ceb06d31b admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:04.180247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c92dcc-7218-4cd2-9935-6828e2af7d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:04.181648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c92dcc-7218-4cd2-9935-6828e2af7d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:04.182030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c92dcc-7218-4cd2-9935-6828e2af7d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:04.182653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c92dcc-7218-4cd2-9935-6828e2af7d19 admin admin] PATH_INFO: `/v3/projects/60affdf7a4d845deb29a78295263347d/users/4a83f2b2d8774e82abd67619c433e5c0/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:04.193558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54676d2-550d-472d-92d8-8b02cab22931 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:04.200014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61db0b-e6bf-4440-8846-e99d249d915e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:04.200665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61db0b-e6bf-4440-8846-e99d249d915e service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:04.200942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61db0b-e6bf-4440-8846-e99d249d915e service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:04.201220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61db0b-e6bf-4440-8846-e99d249d915e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:04.212821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61db0b-e6bf-4440-8846-e99d249d915e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:04.215070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61db0b-e6bf-4440-8846-e99d249d915e service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:04.220361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c92dcc-7218-4cd2-9935-6828e2af7d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60affdf7a4d845deb29a78295263347d, user_id=4a83f2b2d8774e82abd67619c433e5c0, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:04.225064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c92dcc-7218-4cd2-9935-6828e2af7d19 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:04.230297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 956/1887] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:04.289664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61db0b-e6bf-4440-8846-e99d249d915e service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:04.291145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1c61db0b-e6bf-4440-8846-e99d249d915e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:04.303234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61db0b-e6bf-4440-8846-e99d249d915e service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:04.307235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0c8e9-aa48-4b44-a14d-c2b95e8e15d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:04.308451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c8e9-aa48-4b44-a14d-c2b95e8e15d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:04.308752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c8e9-aa48-4b44-a14d-c2b95e8e15d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:04.308990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c8e9-aa48-4b44-a14d-c2b95e8e15d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:04.311006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a1c0c8e9-aa48-4b44-a14d-c2b95e8e15d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:04.322849 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 932/1888] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:04 2022] PUT /identity/v3/projects/60affdf7a4d845deb29a78295263347d/users/4a83f2b2d8774e82abd67619c433e5c0/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:04.334002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d187d-11a9-415c-a2ac-382a75da7349 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:04.334750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d187d-11a9-415c-a2ac-382a75da7349 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:04.335644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d187d-11a9-415c-a2ac-382a75da7349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:04.365800 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:04.369171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e87d187d-11a9-415c-a2ac-382a75da7349 None None] MFA Rules not processed for user `4a83f2b2d8774e82abd67619c433e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:04.371093 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e87d187d-11a9-415c-a2ac-382a75da7349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:04.381240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0c8e9-aa48-4b44-a14d-c2b95e8e15d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:04.382723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0c8e9-aa48-4b44-a14d-c2b95e8e15d9 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:04.392860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 957/1889] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:04.449392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 933/1890] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:04.454215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0c8e9-aa48-4b44-a14d-c2b95e8e15d9 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:04.473548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0c8e9-aa48-4b44-a14d-c2b95e8e15d9 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:04.536099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1473fb6-0598-4e9f-9ee3-784f781ad33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:04.536808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1473fb6-0598-4e9f-9ee3-784f781ad33f admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:04.536808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1473fb6-0598-4e9f-9ee3-784f781ad33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:04.537000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1473fb6-0598-4e9f-9ee3-784f781ad33f admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:04.537670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1473fb6-0598-4e9f-9ee3-784f781ad33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:04.539829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1473fb6-0598-4e9f-9ee3-784f781ad33f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:04.670760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 958/1891] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:04 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:04.675533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d187d-11a9-415c-a2ac-382a75da7349 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:04.719390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d187d-11a9-415c-a2ac-382a75da7349 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:04.857493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ac735-9d8f-445c-8fb5-357a5657e04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:04.858382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ac735-9d8f-445c-8fb5-357a5657e04b admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:04.858760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ac735-9d8f-445c-8fb5-357a5657e04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:04.859179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ac735-9d8f-445c-8fb5-357a5657e04b admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:04.859952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ac735-9d8f-445c-8fb5-357a5657e04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:04.862384 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ac735-9d8f-445c-8fb5-357a5657e04b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:04.975887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 934/1892] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:04 2022] POST /identity/v3/users => generated 300 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:04.976704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1473fb6-0598-4e9f-9ee3-784f781ad33f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:04.988374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1473fb6-0598-4e9f-9ee3-784f781ad33f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:04.993695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171e5ea-e707-46d9-afcf-a0dd889748cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:04.994458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171e5ea-e707-46d9-afcf-a0dd889748cf admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:04.994626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171e5ea-e707-46d9-afcf-a0dd889748cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:04.995701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171e5ea-e707-46d9-afcf-a0dd889748cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:04.996697 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171e5ea-e707-46d9-afcf-a0dd889748cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:04.998119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171e5ea-e707-46d9-afcf-a0dd889748cf admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:05.012456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 959/1893] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:05.017148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ac735-9d8f-445c-8fb5-357a5657e04b admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:05.030620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ac735-9d8f-445c-8fb5-357a5657e04b admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:05.037339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a2f77-597d-4139-8bf3-4c6e837e765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:05.038563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a2f77-597d-4139-8bf3-4c6e837e765a admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:05.038893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a2f77-597d-4139-8bf3-4c6e837e765a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:05.039594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a2f77-597d-4139-8bf3-4c6e837e765a admin admin] PATH_INFO: `/v3/projects/e3464da8f36e4f5cae09d45d72a09dd1/users/353257ab1bf44c758fdf294f7072bf46/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:05.043379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:05.064426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a2f77-597d-4139-8bf3-4c6e837e765a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3464da8f36e4f5cae09d45d72a09dd1, user_id=353257ab1bf44c758fdf294f7072bf46, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:05.067436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a2f77-597d-4139-8bf3-4c6e837e765a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:05.157188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 935/1894] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:05 2022] PUT /identity/v3/projects/e3464da8f36e4f5cae09d45d72a09dd1/users/353257ab1bf44c758fdf294f7072bf46/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:05.173475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171e5ea-e707-46d9-afcf-a0dd889748cf admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:05.181750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171e5ea-e707-46d9-afcf-a0dd889748cf admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:05.261647 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7cc26-7a92-43d7-afcf-c3f45b06c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:05.262281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7cc26-7a92-43d7-afcf-c3f45b06c5cc admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:05.262698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7cc26-7a92-43d7-afcf-c3f45b06c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:05.262973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7cc26-7a92-43d7-afcf-c3f45b06c5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:05.263903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7cc26-7a92-43d7-afcf-c3f45b06c5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:05.265770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7cc26-7a92-43d7-afcf-c3f45b06c5cc admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:05.290928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 960/1895] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:05.295180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a2f77-597d-4139-8bf3-4c6e837e765a admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:05.307413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a2f77-597d-4139-8bf3-4c6e837e765a admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:05.313872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377559c-ecef-40d2-9f49-d36c6e3d7bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:05.314929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377559c-ecef-40d2-9f49-d36c6e3d7bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:05.315571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377559c-ecef-40d2-9f49-d36c6e3d7bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:05.316024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377559c-ecef-40d2-9f49-d36c6e3d7bf7 admin admin] PATH_INFO: `/v3/projects/e3464da8f36e4f5cae09d45d72a09dd1/users/353257ab1bf44c758fdf294f7072bf46/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:05.318493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377559c-ecef-40d2-9f49-d36c6e3d7bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3464da8f36e4f5cae09d45d72a09dd1, user_id=353257ab1bf44c758fdf294f7072bf46, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:05.321522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377559c-ecef-40d2-9f49-d36c6e3d7bf7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:05.339030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 936/1896] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:05 2022] PUT /identity/v3/projects/e3464da8f36e4f5cae09d45d72a09dd1/users/353257ab1bf44c758fdf294f7072bf46/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:05.349669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f697-687c-4eae-9be6-1f38af7d2d26 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:05.349669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f697-687c-4eae-9be6-1f38af7d2d26 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:05.350023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f697-687c-4eae-9be6-1f38af7d2d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:05.385206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9c89f697-687c-4eae-9be6-1f38af7d2d26 None None] MFA Rules not processed for user `353257ab1bf44c758fdf294f7072bf46`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:05.387796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9c89f697-687c-4eae-9be6-1f38af7d2d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:05.461651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:05.515179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 961/1897] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:05.566384 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377559c-ecef-40d2-9f49-d36c6e3d7bf7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:05.644056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377559c-ecef-40d2-9f49-d36c6e3d7bf7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:05.648055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a8b1a-30b8-4ae5-ab9b-be51c1b1bff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:05.648689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8b1a-30b8-4ae5-ab9b-be51c1b1bff8 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:05.648975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8b1a-30b8-4ae5-ab9b-be51c1b1bff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:05.649253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8b1a-30b8-4ae5-ab9b-be51c1b1bff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:05.661409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a8b1a-30b8-4ae5-ab9b-be51c1b1bff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:05.667662 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a8b1a-30b8-4ae5-ab9b-be51c1b1bff8 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:05.680102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 937/1898] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:05.737929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89f697-687c-4eae-9be6-1f38af7d2d26 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:05.740434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9c89f697-687c-4eae-9be6-1f38af7d2d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:05.840762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a8b1a-30b8-4ae5-ab9b-be51c1b1bff8 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:05.844436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89f697-687c-4eae-9be6-1f38af7d2d26 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:05.849824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:05.850966 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:05.851388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:05.851802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] PATH_INFO: `/v3/users/6845cfd733b349debafaa215bbee8000` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:05.854828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6845cfd733b349debafaa215bbee8000)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:05.857811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a8b1a-30b8-4ae5-ab9b-be51c1b1bff8 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:05.858077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:05.877270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:05.880473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:05.880473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:05.880473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] PATH_INFO: `/v3/users/4a83f2b2d8774e82abd67619c433e5c0` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:05.880473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a83f2b2d8774e82abd67619c433e5c0)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:05.881619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:06.118431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a83f2b2d8774e82abd67619c433e5c0'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:06.119605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a83f2b2d8774e82abd67619c433e5c0'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:06.123988 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6845cfd733b349debafaa215bbee8000'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:06.125039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6845cfd733b349debafaa215bbee8000'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:06.131580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a83f2b2d8774e82abd67619c433e5c0'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:06.132377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a83f2b2d8774e82abd67619c433e5c0'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:06.137942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6845cfd733b349debafaa215bbee8000'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:06.168010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6845cfd733b349debafaa215bbee8000'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:06.298937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fbe0dc8d-5bbd-4de7-946b-07b35a85ae5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a83f2b2d8774e82abd67619c433e5c0'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:06.346214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 938/1899] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:05 2022] DELETE /identity/v3/users/4a83f2b2d8774e82abd67619c433e5c0 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:06.351256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321328-01f4-41c0-8c6b-724bc8961c9d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:06.351543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321328-01f4-41c0-8c6b-724bc8961c9d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:06.352039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321328-01f4-41c0-8c6b-724bc8961c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:06.375846 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b0321328-01f4-41c0-8c6b-724bc8961c9d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:06.377346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b0321328-01f4-41c0-8c6b-724bc8961c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:06.377662 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-41e2d138-1585-4f96-8252-691f46b077fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6845cfd733b349debafaa215bbee8000'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:06.388305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 962/1900] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:05 2022] DELETE /identity/v3/users/6845cfd733b349debafaa215bbee8000 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:06.393657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842f35-0b61-4a7b-a215-d364e098edc9 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:06.394473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842f35-0b61-4a7b-a215-d364e098edc9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:06.394905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842f35-0b61-4a7b-a215-d364e098edc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:06.425615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-1e842f35-0b61-4a7b-a215-d364e098edc9 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:06.426892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1e842f35-0b61-4a7b-a215-d364e098edc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:06.442857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:06.486437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 939/1901] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:06.498551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0321328-01f4-41c0-8c6b-724bc8961c9d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:06.500127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b0321328-01f4-41c0-8c6b-724bc8961c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:06.505898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:06.517812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 963/1902] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:06.534852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842f35-0b61-4a7b-a215-d364e098edc9 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:06.538413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1e842f35-0b61-4a7b-a215-d364e098edc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:06.650781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842f35-0b61-4a7b-a215-d364e098edc9 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:06.651957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0321328-01f4-41c0-8c6b-724bc8961c9d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:06.656334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1f6d2-3919-4078-a7c0-771ce4f0c6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:06.657182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f6d2-3919-4078-a7c0-771ce4f0c6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:06.657522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f6d2-3919-4078-a7c0-771ce4f0c6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:06.666079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f6d2-3919-4078-a7c0-771ce4f0c6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:06.666232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62502b4a-cee6-43ef-81d0-234ff3da40c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:06.666232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502b4a-cee6-43ef-81d0-234ff3da40c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:06.666232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502b4a-cee6-43ef-81d0-234ff3da40c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:06.666232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502b4a-cee6-43ef-81d0-234ff3da40c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:06.672752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1f6d2-3919-4078-a7c0-771ce4f0c6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:06.673966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62502b4a-cee6-43ef-81d0-234ff3da40c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:06.674333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1f6d2-3919-4078-a7c0-771ce4f0c6c1 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:06.675463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62502b4a-cee6-43ef-81d0-234ff3da40c3 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:06.687732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 964/1903] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:06.696842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 940/1904] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:07.425269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1f6d2-3919-4078-a7c0-771ce4f0c6c1 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:07.427404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e9b1f6d2-3919-4078-a7c0-771ce4f0c6c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:07.459720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1f6d2-3919-4078-a7c0-771ce4f0c6c1 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:07.483996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:07.484948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:07.485280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:07.489782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] PATH_INFO: `/v3/projects/7297d74f4059466aa3118b868635b24e` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:07.489782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7297d74f4059466aa3118b868635b24e)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:07.489782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:07.609172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62502b4a-cee6-43ef-81d0-234ff3da40c3 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:07.612395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-62502b4a-cee6-43ef-81d0-234ff3da40c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:07.634407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62502b4a-cee6-43ef-81d0-234ff3da40c3 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:07.643869 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:07.645052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:07.645373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:07.645656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] PATH_INFO: `/v3/projects/60affdf7a4d845deb29a78295263347d` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:07.658590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=60affdf7a4d845deb29a78295263347d)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:07.661273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:07.710661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7297d74f4059466aa3118b868635b24e', 'request_id': 'req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:07.735931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7297d74f4059466aa3118b868635b24e', 'request_id': 'req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:07.807136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7297d74f4059466aa3118b868635b24e', 'request_id': 'req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:07.833807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] The token cache is being invalidate because project 7297d74f4059466aa3118b868635b24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:07.834601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:07.836285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:07.839621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 965/1905] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:07 2022] DELETE /identity/v3/projects/7297d74f4059466aa3118b868635b24e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:07.846101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60affdf7a4d845deb29a78295263347d', 'request_id': 'req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:07.847060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:07.849819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:07.857891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60affdf7a4d845deb29a78295263347d', 'request_id': 'req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:07.997511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60affdf7a4d845deb29a78295263347d', 'request_id': 'req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.015604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf3f54-ea0c-42b9-ac5c-cfdfd31af10b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:08.038299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] The token cache is being invalidate because project 60affdf7a4d845deb29a78295263347d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:08.039318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.043595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.047401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 941/1906] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:07 2022] DELETE /identity/v3/projects/60affdf7a4d845deb29a78295263347d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:08.055922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:08.062108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:08.098926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:08.163792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:08.165488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:08.165488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:08.165488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] PATH_INFO: `/v3/users/d474786bd0034efea190fb8cc049b9cf` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:08.169019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d474786bd0034efea190fb8cc049b9cf)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:08.171536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:08.206440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1d746-0e0f-4b8d-8435-89ee98c2c30e admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:08.222782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:08.223558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:08.223976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:08.224330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] PATH_INFO: `/v3/users/353257ab1bf44c758fdf294f7072bf46` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:08.234382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=353257ab1bf44c758fdf294f7072bf46)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:08.236598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:08.254138 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:08.461966 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd474786bd0034efea190fb8cc049b9cf'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.463325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353257ab1bf44c758fdf294f7072bf46'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.463724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd474786bd0034efea190fb8cc049b9cf'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.464359 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353257ab1bf44c758fdf294f7072bf46'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.479245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd474786bd0034efea190fb8cc049b9cf'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.489462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353257ab1bf44c758fdf294f7072bf46'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.490338 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353257ab1bf44c758fdf294f7072bf46'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.519516 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd474786bd0034efea190fb8cc049b9cf'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.607861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353257ab1bf44c758fdf294f7072bf46'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.647697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 942/1907] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:08 2022] DELETE /identity/v3/users/353257ab1bf44c758fdf294f7072bf46 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:08.748954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd474786bd0034efea190fb8cc049b9cf'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.769220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 966/1908] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:07 2022] DELETE /identity/v3/users/d474786bd0034efea190fb8cc049b9cf => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:09.569220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:09.571390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:09.582260 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:09.584370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:09.695836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658f6cd-7df6-404d-b697-ab9aec46bcdd admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:09.737756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd93c5-2ace-456a-a630-37e4f97104fb admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:09.742595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:09.743542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.743829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.744100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] PATH_INFO: `/v3/projects/7b0e05faab7d4d849c0831fd64b8f5c9` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.746846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0e05faab7d4d849c0831fd64b8f5c9)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:09.748813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:09.775966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:09.777413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.777796 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.778177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] PATH_INFO: `/v3/projects/e3464da8f36e4f5cae09d45d72a09dd1` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.779866 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3464da8f36e4f5cae09d45d72a09dd1)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:09.782430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:09.914245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0e05faab7d4d849c0831fd64b8f5c9', 'request_id': 'req-6fcda290-33ce-4668-92d5-cb340d5ec8ca'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:09.915259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:09.925565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3464da8f36e4f5cae09d45d72a09dd1', 'request_id': 'req-3f670d98-036f-4ff3-b516-44aadf204444'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:09.934013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3464da8f36e4f5cae09d45d72a09dd1', 'request_id': 'req-3f670d98-036f-4ff3-b516-44aadf204444'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:09.941806 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0e05faab7d4d849c0831fd64b8f5c9', 'request_id': 'req-6fcda290-33ce-4668-92d5-cb340d5ec8ca'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:09.943759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:10.036514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3464da8f36e4f5cae09d45d72a09dd1', 'request_id': 'req-3f670d98-036f-4ff3-b516-44aadf204444'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.052097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] The token cache is being invalidate because project e3464da8f36e4f5cae09d45d72a09dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:10.052397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.053608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f670d98-036f-4ff3-b516-44aadf204444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.062294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 943/1909] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:09 2022] DELETE /identity/v3/projects/e3464da8f36e4f5cae09d45d72a09dd1 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:10.075928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab680a1-c90b-4a2e-92c5-203f583dd34f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.076462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab680a1-c90b-4a2e-92c5-203f583dd34f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.076782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab680a1-c90b-4a2e-92c5-203f583dd34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.097504 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0e05faab7d4d849c0831fd64b8f5c9', 'request_id': 'req-6fcda290-33ce-4668-92d5-cb340d5ec8ca'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.099462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-1ab680a1-c90b-4a2e-92c5-203f583dd34f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:10.100918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1ab680a1-c90b-4a2e-92c5-203f583dd34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:10.114855 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] The token cache is being invalidate because project 7b0e05faab7d4d849c0831fd64b8f5c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:10.115408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.116486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6fcda290-33ce-4668-92d5-cb340d5ec8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.118534 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 967/1910] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:09 2022] DELETE /identity/v3/projects/7b0e05faab7d4d849c0831fd64b8f5c9 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:10.125095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d6ea-2169-4106-a2b5-e3ea45d0090f None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.125607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d6ea-2169-4106-a2b5-e3ea45d0090f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.126047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d6ea-2169-4106-a2b5-e3ea45d0090f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.153231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-5127d6ea-2169-4106-a2b5-e3ea45d0090f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:10.154611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5127d6ea-2169-4106-a2b5-e3ea45d0090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:10.195096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 944/1911] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:10.206573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0cb38-2abd-4fc0-ac8f-bfda668422f4 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.206937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0cb38-2abd-4fc0-ac8f-bfda668422f4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.207228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0cb38-2abd-4fc0-ac8f-bfda668422f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.235118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-69f0cb38-2abd-4fc0-ac8f-bfda668422f4 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:10.236431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-69f0cb38-2abd-4fc0-ac8f-bfda668422f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:10.247429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 945/1912] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:10.251559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0cb38-2abd-4fc0-ac8f-bfda668422f4 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:10.264005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0cb38-2abd-4fc0-ac8f-bfda668422f4 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:10.271553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d596c-5a8d-4d16-ac4a-419b43e6d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:10.272296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d596c-5a8d-4d16-ac4a-419b43e6d915 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.272739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d596c-5a8d-4d16-ac4a-419b43e6d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.272945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d596c-5a8d-4d16-ac4a-419b43e6d915 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.274017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d596c-5a8d-4d16-ac4a-419b43e6d915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:10.276566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d596c-5a8d-4d16-ac4a-419b43e6d915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:10.277245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 968/1913] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:10.278526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d596c-5a8d-4d16-ac4a-419b43e6d915 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:10.280028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c3e3-fe0b-4292-9032-60ba83d8f81b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.280497 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c3e3-fe0b-4292-9032-60ba83d8f81b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.281204 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c3e3-fe0b-4292-9032-60ba83d8f81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.293905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 946/1914] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:10.299449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d596c-5a8d-4d16-ac4a-419b43e6d915 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:10.311179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d596c-5a8d-4d16-ac4a-419b43e6d915 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:10.311498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-4048c3e3-fe0b-4292-9032-60ba83d8f81b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:10.312906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4048c3e3-fe0b-4292-9032-60ba83d8f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:10.316124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43a76b-d3af-4ce3-b347-905424653cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:10.317478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43a76b-d3af-4ce3-b347-905424653cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.317478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43a76b-d3af-4ce3-b347-905424653cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.317478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43a76b-d3af-4ce3-b347-905424653cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.318370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43a76b-d3af-4ce3-b347-905424653cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:10.321007 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43a76b-d3af-4ce3-b347-905424653cf6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:10.338419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 969/1915] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:10.343812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c3e3-fe0b-4292-9032-60ba83d8f81b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:10.356943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c3e3-fe0b-4292-9032-60ba83d8f81b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:10.362645 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ebae3-75b9-45a1-8b32-f22ed7fdfb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:10.363274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebae3-75b9-45a1-8b32-f22ed7fdfb3c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.363596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebae3-75b9-45a1-8b32-f22ed7fdfb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.363870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebae3-75b9-45a1-8b32-f22ed7fdfb3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.364869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ebae3-75b9-45a1-8b32-f22ed7fdfb3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:10.365166 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ebae3-75b9-45a1-8b32-f22ed7fdfb3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:10.367043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ebae3-75b9-45a1-8b32-f22ed7fdfb3c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:10.390300 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 970/1916] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:26:10.392190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ebae3-75b9-45a1-8b32-f22ed7fdfb3c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:10.394696 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e57ebae3-75b9-45a1-8b32-f22ed7fdfb3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:10.423936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ebae3-75b9-45a1-8b32-f22ed7fdfb3c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:10.430553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:10.431557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.432442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.433704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] PATH_INFO: `/v3/users/2a04673beff0461d868aa2f30c52bab8` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.436329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a04673beff0461d868aa2f30c52bab8)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:10.439637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:10.452964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 947/1917] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:10 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:10.458054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43a76b-d3af-4ce3-b347-905424653cf6 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:10.565593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43a76b-d3af-4ce3-b347-905424653cf6 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:10.571296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39bc85-208b-4f81-a210-6bb0c9c0975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:10.572049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39bc85-208b-4f81-a210-6bb0c9c0975f admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.572215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39bc85-208b-4f81-a210-6bb0c9c0975f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.572493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39bc85-208b-4f81-a210-6bb0c9c0975f admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.573224 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39bc85-208b-4f81-a210-6bb0c9c0975f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:10.575321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39bc85-208b-4f81-a210-6bb0c9c0975f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:10.675440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 948/1918] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:10 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:10.675440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39bc85-208b-4f81-a210-6bb0c9c0975f admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:10.685039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a04673beff0461d868aa2f30c52bab8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.685720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a04673beff0461d868aa2f30c52bab8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.693569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a04673beff0461d868aa2f30c52bab8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.707291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a04673beff0461d868aa2f30c52bab8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.746631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39bc85-208b-4f81-a210-6bb0c9c0975f admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:10.752082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424134-22f3-4150-82ac-1dcec30741b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:10.752726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424134-22f3-4150-82ac-1dcec30741b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.753223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424134-22f3-4150-82ac-1dcec30741b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.753481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424134-22f3-4150-82ac-1dcec30741b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.754161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424134-22f3-4150-82ac-1dcec30741b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:10.756534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424134-22f3-4150-82ac-1dcec30741b4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:10.788932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a04673beff0461d868aa2f30c52bab8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:10.796040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 971/1919] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:10 2022] DELETE /identity/v3/users/2a04673beff0461d868aa2f30c52bab8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:10.797023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:10.798423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:10.887486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ab014-839b-4b8f-b776-4c3820569d23 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:10.892303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961db2e-2544-40a8-a308-616be867c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:10.892944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961db2e-2544-40a8-a308-616be867c6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.893226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961db2e-2544-40a8-a308-616be867c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.893551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961db2e-2544-40a8-a308-616be867c6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.894357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961db2e-2544-40a8-a308-616be867c6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:10.896481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961db2e-2544-40a8-a308-616be867c6d1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.000434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 949/1920] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:10 2022] POST /identity/v3/users => generated 301 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:11.000434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbae86-6894-42d9-ac1b-3acbb5d638dd None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.000434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbae86-6894-42d9-ac1b-3acbb5d638dd None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.000434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbae86-6894-42d9-ac1b-3acbb5d638dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.000434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e3fbae86-6894-42d9-ac1b-3acbb5d638dd None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:11.000434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e3fbae86-6894-42d9-ac1b-3acbb5d638dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:11.005023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 950/1921] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:11.005891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbae86-6894-42d9-ac1b-3acbb5d638dd None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.007332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e3fbae86-6894-42d9-ac1b-3acbb5d638dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:11.020347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbae86-6894-42d9-ac1b-3acbb5d638dd None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.026658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b54aa2-3148-4619-9326-5c430d05b68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.027583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b54aa2-3148-4619-9326-5c430d05b68c admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.028694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b54aa2-3148-4619-9326-5c430d05b68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.028694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b54aa2-3148-4619-9326-5c430d05b68c admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.029274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b54aa2-3148-4619-9326-5c430d05b68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.031096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b54aa2-3148-4619-9326-5c430d05b68c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.044798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 951/1922] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:11.045552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b54aa2-3148-4619-9326-5c430d05b68c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.047799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a4b54aa2-3148-4619-9326-5c430d05b68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:11.101891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 972/1923] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:10 2022] POST /identity/v3/users => generated 287 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:11.103035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961db2e-2544-40a8-a308-616be867c6d1 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.115174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961db2e-2544-40a8-a308-616be867c6d1 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.123597 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ebf2-6624-4075-b08e-8b1d6cb7cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.124995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ebf2-6624-4075-b08e-8b1d6cb7cefa admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.125616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ebf2-6624-4075-b08e-8b1d6cb7cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.126585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ebf2-6624-4075-b08e-8b1d6cb7cefa admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.128058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ebf2-6624-4075-b08e-8b1d6cb7cefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.131291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ebf2-6624-4075-b08e-8b1d6cb7cefa admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.135199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b54aa2-3148-4619-9326-5c430d05b68c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.141025 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f677d-10ac-4e94-82c6-42d51bbcf402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.147951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f677d-10ac-4e94-82c6-42d51bbcf402 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.147951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f677d-10ac-4e94-82c6-42d51bbcf402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.147951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f677d-10ac-4e94-82c6-42d51bbcf402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.153780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 973/1924] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:11.155415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ebf2-6624-4075-b08e-8b1d6cb7cefa admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.158496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f677d-10ac-4e94-82c6-42d51bbcf402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.160287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f677d-10ac-4e94-82c6-42d51bbcf402 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.188748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ebf2-6624-4075-b08e-8b1d6cb7cefa admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.188912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 952/1925] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:11.188912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f677d-10ac-4e94-82c6-42d51bbcf402 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.189048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dff4e5-477d-41c5-852e-7600d1a47a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.189048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dff4e5-477d-41c5-852e-7600d1a47a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.189048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dff4e5-477d-41c5-852e-7600d1a47a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.189627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dff4e5-477d-41c5-852e-7600d1a47a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.191189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dff4e5-477d-41c5-852e-7600d1a47a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.194756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f677d-10ac-4e94-82c6-42d51bbcf402 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.194946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dff4e5-477d-41c5-852e-7600d1a47a94 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.210246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0974d-7e65-476a-bc2b-73290de5eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.214887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 974/1926] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:11.216163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dff4e5-477d-41c5-852e-7600d1a47a94 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.218620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0974d-7e65-476a-bc2b-73290de5eab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.221994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0974d-7e65-476a-bc2b-73290de5eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.222544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0974d-7e65-476a-bc2b-73290de5eab6 admin admin] PATH_INFO: `/v3/projects/76e83486a2dd4c8c98ad83561c3bc3a1/users/d55e7d33d9e34f32852496dbf63e18c9/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.228173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dff4e5-477d-41c5-852e-7600d1a47a94 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.235379 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14946-9f53-4b5e-b682-a8ae99573f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.236153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14946-9f53-4b5e-b682-a8ae99573f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.236440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14946-9f53-4b5e-b682-a8ae99573f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.236700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14946-9f53-4b5e-b682-a8ae99573f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.237420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf14946-9f53-4b5e-b682-a8ae99573f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.239742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf14946-9f53-4b5e-b682-a8ae99573f79 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.252713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0974d-7e65-476a-bc2b-73290de5eab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e83486a2dd4c8c98ad83561c3bc3a1, user_id=d55e7d33d9e34f32852496dbf63e18c9, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.252936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 975/1927] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:11.258533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14946-9f53-4b5e-b682-a8ae99573f79 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.258706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0974d-7e65-476a-bc2b-73290de5eab6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.268354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14946-9f53-4b5e-b682-a8ae99573f79 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.273689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0779a-286a-432a-835e-7b78b8367668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.274530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0779a-286a-432a-835e-7b78b8367668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.274803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0779a-286a-432a-835e-7b78b8367668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.275075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0779a-286a-432a-835e-7b78b8367668 admin admin] PATH_INFO: `/v3/projects/671028c2e017478ca491fb8073355ddc/users/f640b3dbbc63464c8ae2b18817e633a6/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.313854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0779a-286a-432a-835e-7b78b8367668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671028c2e017478ca491fb8073355ddc, user_id=f640b3dbbc63464c8ae2b18817e633a6, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.318287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0779a-286a-432a-835e-7b78b8367668 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.364549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 953/1928] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:11 2022] PUT /identity/v3/projects/76e83486a2dd4c8c98ad83561c3bc3a1/users/d55e7d33d9e34f32852496dbf63e18c9/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:11.380834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0974d-7e65-476a-bc2b-73290de5eab6 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.383329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2fd0974d-7e65-476a-bc2b-73290de5eab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:11.401973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 976/1929] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:11 2022] PUT /identity/v3/projects/671028c2e017478ca491fb8073355ddc/users/f640b3dbbc63464c8ae2b18817e633a6/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:11.401973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6faabc-ac44-47c3-9e62-c1e89821facb None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.401973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6faabc-ac44-47c3-9e62-c1e89821facb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.401973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6faabc-ac44-47c3-9e62-c1e89821facb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.455533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0b6faabc-ac44-47c3-9e62-c1e89821facb None None] MFA Rules not processed for user `d55e7d33d9e34f32852496dbf63e18c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:11.455889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:11.456980 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0b6faabc-ac44-47c3-9e62-c1e89821facb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:11.521203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0974d-7e65-476a-bc2b-73290de5eab6 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.554444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 977/1930] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:11.555752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef810165-49e0-47c6-950e-54d38f5e038a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.556452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef810165-49e0-47c6-950e-54d38f5e038a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.556733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef810165-49e0-47c6-950e-54d38f5e038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.574705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:11.600209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.601833 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.602359 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.602822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] PATH_INFO: `/v3/users/b804b27e1362465b8be1c94a884c5eb7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.605656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b804b27e1362465b8be1c94a884c5eb7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.605962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ef810165-49e0-47c6-950e-54d38f5e038a None None] MFA Rules not processed for user `f640b3dbbc63464c8ae2b18817e633a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:11.607417 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ef810165-49e0-47c6-950e-54d38f5e038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:11.608324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.740133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 978/1931] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:11.741952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef810165-49e0-47c6-950e-54d38f5e038a None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.763018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef810165-49e0-47c6-950e-54d38f5e038a None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.769945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ab060-4539-4ce1-9064-1f91daf5f301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.771183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ab060-4539-4ce1-9064-1f91daf5f301 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.771628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ab060-4539-4ce1-9064-1f91daf5f301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.772056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ab060-4539-4ce1-9064-1f91daf5f301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.772887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ab060-4539-4ce1-9064-1f91daf5f301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.775054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ab060-4539-4ce1-9064-1f91daf5f301 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.856319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b804b27e1362465b8be1c94a884c5eb7'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:11.857178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b804b27e1362465b8be1c94a884c5eb7'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:11.866014 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b804b27e1362465b8be1c94a884c5eb7'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:11.870721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b804b27e1362465b8be1c94a884c5eb7'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:11.905950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 979/1932] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:11 2022] POST /identity/v3/projects => generated 401 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:11.906667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ab060-4539-4ce1-9064-1f91daf5f301 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.908813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6d5ab060-4539-4ce1-9064-1f91daf5f301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:11.966043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b804b27e1362465b8be1c94a884c5eb7'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:11.977783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ab060-4539-4ce1-9064-1f91daf5f301 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.983686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b1c53-2074-4897-bbf9-a64c0bcfdc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.984689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b1c53-2074-4897-bbf9-a64c0bcfdc2e admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.984968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b1c53-2074-4897-bbf9-a64c0bcfdc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.985254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b1c53-2074-4897-bbf9-a64c0bcfdc2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.985947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b1c53-2074-4897-bbf9-a64c0bcfdc2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.987683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 954/1933] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:11 2022] DELETE /identity/v3/users/b804b27e1362465b8be1c94a884c5eb7 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:11.988249 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b1c53-2074-4897-bbf9-a64c0bcfdc2e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:11.988605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.990012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:12.058595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b9a7e-dab7-4327-bfbb-2d8f90979e95 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.063482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.064129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.064408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.064694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] PATH_INFO: `/v3/projects/069395b5eb744d9d92762ee4c19b99f1` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.065890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=069395b5eb744d9d92762ee4c19b99f1)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.067870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.077048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 980/1934] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:11 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:12.077824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b1c53-2074-4897-bbf9-a64c0bcfdc2e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.081270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ca8b1c53-2074-4897-bbf9-a64c0bcfdc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:12.149468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b1c53-2074-4897-bbf9-a64c0bcfdc2e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.156360 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc66c1-3484-46b7-a90c-1fdffa7964a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.157012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc66c1-3484-46b7-a90c-1fdffa7964a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.157292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc66c1-3484-46b7-a90c-1fdffa7964a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.157559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc66c1-3484-46b7-a90c-1fdffa7964a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.158214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc66c1-3484-46b7-a90c-1fdffa7964a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.160501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc66c1-3484-46b7-a90c-1fdffa7964a8 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.218578 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069395b5eb744d9d92762ee4c19b99f1', 'request_id': 'req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:12.224632 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069395b5eb744d9d92762ee4c19b99f1', 'request_id': 'req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:12.294321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 981/1935] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:12 2022] POST /identity/v3/users => generated 307 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:12.295728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673a68-3a44-4f7d-a80f-96b2857600e1 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.296016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673a68-3a44-4f7d-a80f-96b2857600e1 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.296296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673a68-3a44-4f7d-a80f-96b2857600e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.308713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069395b5eb744d9d92762ee4c19b99f1', 'request_id': 'req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:12.317585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-91673a68-3a44-4f7d-a80f-96b2857600e1 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:12.318922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-91673a68-3a44-4f7d-a80f-96b2857600e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:12.321099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] The token cache is being invalidate because project 069395b5eb744d9d92762ee4c19b99f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:12.321392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:12.322069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:12.323808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 955/1936] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:11 2022] DELETE /identity/v3/projects/069395b5eb744d9d92762ee4c19b99f1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:12.324586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.328838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:12.386207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 982/1937] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:12.387179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673a68-3a44-4f7d-a80f-96b2857600e1 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.390721 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-91673a68-3a44-4f7d-a80f-96b2857600e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:12.395412 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff61fd-cae6-4e18-92e0-8065cecdb0c4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.402366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:12.403344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f042ea-7078-4b94-9a05-89fd95246f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.404351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673a68-3a44-4f7d-a80f-96b2857600e1 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.404508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f042ea-7078-4b94-9a05-89fd95246f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.404650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f042ea-7078-4b94-9a05-89fd95246f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.405033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f042ea-7078-4b94-9a05-89fd95246f4d admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.406228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f042ea-7078-4b94-9a05-89fd95246f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.408580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f042ea-7078-4b94-9a05-89fd95246f4d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.408883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ccc2-aa6f-4193-9a7e-4583837f7291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.409501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ccc2-aa6f-4193-9a7e-4583837f7291 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.409810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ccc2-aa6f-4193-9a7e-4583837f7291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.410412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ccc2-aa6f-4193-9a7e-4583837f7291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.411116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177ccc2-aa6f-4193-9a7e-4583837f7291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.412686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177ccc2-aa6f-4193-9a7e-4583837f7291 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.423794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 983/1938] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:12.424455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ccc2-aa6f-4193-9a7e-4583837f7291 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.426127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9177ccc2-aa6f-4193-9a7e-4583837f7291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:12.443666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ccc2-aa6f-4193-9a7e-4583837f7291 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.449720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.450602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.451095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.451373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] PATH_INFO: `/v3/users/25ffc546c33a4a8aade1de28a8b35dd4` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.453168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ffc546c33a4a8aade1de28a8b35dd4)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.455563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.465040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:12.498453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 956/1939] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:12 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:12.499580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f042ea-7078-4b94-9a05-89fd95246f4d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.501349 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-24f042ea-7078-4b94-9a05-89fd95246f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:12.562120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f042ea-7078-4b94-9a05-89fd95246f4d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.566142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f9959-0020-421c-a13b-0e6076d307ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.566893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f9959-0020-421c-a13b-0e6076d307ea service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.567087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f9959-0020-421c-a13b-0e6076d307ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.567397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f9959-0020-421c-a13b-0e6076d307ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.579408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f9959-0020-421c-a13b-0e6076d307ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.580894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f9959-0020-421c-a13b-0e6076d307ea service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.592568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 957/1940] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:12.593411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f9959-0020-421c-a13b-0e6076d307ea service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.608825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f9959-0020-421c-a13b-0e6076d307ea service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.615187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d5a2-47ae-4e34-83f0-738438e129bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.615889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d5a2-47ae-4e34-83f0-738438e129bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.616168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d5a2-47ae-4e34-83f0-738438e129bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.616443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d5a2-47ae-4e34-83f0-738438e129bd admin admin] PATH_INFO: `/v3/projects/680c3a488d8d49979533663dc24ca2dc/users/23c20db8f9994bcba4f24ad5a283ee55/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.637007 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11d5a2-47ae-4e34-83f0-738438e129bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=680c3a488d8d49979533663dc24ca2dc, user_id=23c20db8f9994bcba4f24ad5a283ee55, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.639810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11d5a2-47ae-4e34-83f0-738438e129bd admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.669329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ffc546c33a4a8aade1de28a8b35dd4'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:12.670039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ffc546c33a4a8aade1de28a8b35dd4'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:12.677511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ffc546c33a4a8aade1de28a8b35dd4'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:12.692272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ffc546c33a4a8aade1de28a8b35dd4'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:12.778638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 958/1941] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:12 2022] PUT /identity/v3/projects/680c3a488d8d49979533663dc24ca2dc/users/23c20db8f9994bcba4f24ad5a283ee55/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:12.779623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d5a2-47ae-4e34-83f0-738438e129bd admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.781316 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7c11d5a2-47ae-4e34-83f0-738438e129bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:12.832146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ffc546c33a4a8aade1de28a8b35dd4'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:12.858265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 984/1942] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:12 2022] DELETE /identity/v3/users/25ffc546c33a4a8aade1de28a8b35dd4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:12.859480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.863777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:12.865283 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:12.892459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d5a2-47ae-4e34-83f0-738438e129bd admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.921753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:12.986023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548816da-30ad-460d-ab1f-e736884c99fc admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.996708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9a86-86b4-4aab-ae0a-a18cd46753a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.997824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9a86-86b4-4aab-ae0a-a18cd46753a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.998386 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9a86-86b4-4aab-ae0a-a18cd46753a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.998908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9a86-86b4-4aab-ae0a-a18cd46753a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.999991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae9a86-86b4-4aab-ae0a-a18cd46753a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.002991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae9a86-86b4-4aab-ae0a-a18cd46753a4 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.004858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891553e6-4d30-456a-af16-c0626d4eee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:13.005680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891553e6-4d30-456a-af16-c0626d4eee15 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.006031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891553e6-4d30-456a-af16-c0626d4eee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.006340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891553e6-4d30-456a-af16-c0626d4eee15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.007172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891553e6-4d30-456a-af16-c0626d4eee15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.009024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891553e6-4d30-456a-af16-c0626d4eee15 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.023163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 985/1943] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:13.025032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9a86-86b4-4aab-ae0a-a18cd46753a4 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:13.027463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 959/1944] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:13.028771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891553e6-4d30-456a-af16-c0626d4eee15 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:13.038897 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9a86-86b4-4aab-ae0a-a18cd46753a4 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:13.040521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891553e6-4d30-456a-af16-c0626d4eee15 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:13.044451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f15516-1a49-463b-8f0c-6668cde272c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:13.045147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15516-1a49-463b-8f0c-6668cde272c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.045433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15516-1a49-463b-8f0c-6668cde272c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.045696 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15516-1a49-463b-8f0c-6668cde272c1 admin admin] PATH_INFO: `/v3/projects/680c3a488d8d49979533663dc24ca2dc/users/23c20db8f9994bcba4f24ad5a283ee55/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.051513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f15516-1a49-463b-8f0c-6668cde272c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=680c3a488d8d49979533663dc24ca2dc, user_id=23c20db8f9994bcba4f24ad5a283ee55, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.051513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f15516-1a49-463b-8f0c-6668cde272c1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.052490 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28a5db-937b-478e-8c8f-0eb8b9619253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:13.057928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a5db-937b-478e-8c8f-0eb8b9619253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.057928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a5db-937b-478e-8c8f-0eb8b9619253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.057928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a5db-937b-478e-8c8f-0eb8b9619253 admin admin] PATH_INFO: `/v3/projects/2207b2b32e444294bc4cb512c75fcb7c/users/964c085465164ed3a34f12129ebddbcd/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.070956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 986/1945] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:13 2022] PUT /identity/v3/projects/680c3a488d8d49979533663dc24ca2dc/users/23c20db8f9994bcba4f24ad5a283ee55/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:13.079363 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627ca5-10a7-401e-932f-4e82c16922c2 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.079626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627ca5-10a7-401e-932f-4e82c16922c2 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.080611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627ca5-10a7-401e-932f-4e82c16922c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.091420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28a5db-937b-478e-8c8f-0eb8b9619253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2207b2b32e444294bc4cb512c75fcb7c, user_id=964c085465164ed3a34f12129ebddbcd, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.096693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28a5db-937b-478e-8c8f-0eb8b9619253 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.115236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ef627ca5-10a7-401e-932f-4e82c16922c2 None None] MFA Rules not processed for user `23c20db8f9994bcba4f24ad5a283ee55`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:13.116853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ef627ca5-10a7-401e-932f-4e82c16922c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:13.212878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 987/1947] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:13 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:13.213080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 960/1947] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:13 2022] PUT /identity/v3/projects/2207b2b32e444294bc4cb512c75fcb7c/users/964c085465164ed3a34f12129ebddbcd/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:13.224493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef627ca5-10a7-401e-932f-4e82c16922c2 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:13.225885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28a5db-937b-478e-8c8f-0eb8b9619253 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:13.228174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1e28a5db-937b-478e-8c8f-0eb8b9619253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:13.305742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28a5db-937b-478e-8c8f-0eb8b9619253 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:13.309577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef627ca5-10a7-401e-932f-4e82c16922c2 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:13.312244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c0f77-ac5d-4a49-8805-08fd5f72e437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:13.313125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c0f77-ac5d-4a49-8805-08fd5f72e437 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.313558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c0f77-ac5d-4a49-8805-08fd5f72e437 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.313834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c0f77-ac5d-4a49-8805-08fd5f72e437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.376128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe4f55-82a9-4221-90b9-c29a92fc21d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:13.376671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe4f55-82a9-4221-90b9-c29a92fc21d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.376949 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe4f55-82a9-4221-90b9-c29a92fc21d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.377265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe4f55-82a9-4221-90b9-c29a92fc21d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.377977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe4f55-82a9-4221-90b9-c29a92fc21d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.379912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe4f55-82a9-4221-90b9-c29a92fc21d2 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.395189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 988/1948] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:13.395189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe4f55-82a9-4221-90b9-c29a92fc21d2 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:13.396485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3bbe4f55-82a9-4221-90b9-c29a92fc21d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:13.413435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c0f77-ac5d-4a49-8805-08fd5f72e437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.415127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c0f77-ac5d-4a49-8805-08fd5f72e437 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.427005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 961/1949] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:13 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:13.427502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c0f77-ac5d-4a49-8805-08fd5f72e437 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:13.433605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe4f55-82a9-4221-90b9-c29a92fc21d2 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:13.439761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c0f77-ac5d-4a49-8805-08fd5f72e437 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:13.442723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:13.442723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.442723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.442723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] PATH_INFO: `/v3/projects/cbc604885a1d428ba051606e2ba036a8` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.443261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc604885a1d428ba051606e2ba036a8)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.444611 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2a86f-3f88-4928-905b-a9e6219fb5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:13.445319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2a86f-3f88-4928-905b-a9e6219fb5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.445594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2a86f-3f88-4928-905b-a9e6219fb5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.445759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.445862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2a86f-3f88-4928-905b-a9e6219fb5d6 admin admin] PATH_INFO: `/v3/projects/2207b2b32e444294bc4cb512c75fcb7c/users/964c085465164ed3a34f12129ebddbcd/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.448611 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2a86f-3f88-4928-905b-a9e6219fb5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2207b2b32e444294bc4cb512c75fcb7c, user_id=964c085465164ed3a34f12129ebddbcd, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.451922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2a86f-3f88-4928-905b-a9e6219fb5d6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.466855 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 962/1950] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:13 2022] PUT /identity/v3/projects/2207b2b32e444294bc4cb512c75fcb7c/users/964c085465164ed3a34f12129ebddbcd/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:13.477834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b448d6-27f7-46be-9d79-d00114f59a00 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.489925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b448d6-27f7-46be-9d79-d00114f59a00 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.489925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b448d6-27f7-46be-9d79-d00114f59a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.509745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d0b448d6-27f7-46be-9d79-d00114f59a00 None None] MFA Rules not processed for user `964c085465164ed3a34f12129ebddbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:13.511068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d0b448d6-27f7-46be-9d79-d00114f59a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:13.597218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc604885a1d428ba051606e2ba036a8', 'request_id': 'req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:13.615950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc604885a1d428ba051606e2ba036a8', 'request_id': 'req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:13.620458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 963/1951] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:13.621064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b448d6-27f7-46be-9d79-d00114f59a00 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:13.629782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d0b448d6-27f7-46be-9d79-d00114f59a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:13.693924 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b448d6-27f7-46be-9d79-d00114f59a00 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:13.702861 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc604885a1d428ba051606e2ba036a8', 'request_id': 'req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:13.714598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] The token cache is being invalidate because project cbc604885a1d428ba051606e2ba036a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:13.714969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:13.715771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:13.717398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 989/1952] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:13 2022] DELETE /identity/v3/projects/cbc604885a1d428ba051606e2ba036a8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:13.718385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:13.719775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:13.771323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:13.772264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.772618 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.772901 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] PATH_INFO: `/v3/projects/19c17b75725648f396e7a3baead6fb98` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.774190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c17b75725648f396e7a3baead6fb98)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.776396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.794767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ed4e2-1349-4dc9-a4e0-fe8f78b00dab admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:13.799544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a122a-22c6-4862-baf0-e6989cfae0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:13.800043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a122a-22c6-4862-baf0-e6989cfae0fc service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.800339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a122a-22c6-4862-baf0-e6989cfae0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.800586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a122a-22c6-4862-baf0-e6989cfae0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.805155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bb9a122a-22c6-4862-baf0-e6989cfae0fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:13.828028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:13.866765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a122a-22c6-4862-baf0-e6989cfae0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.868316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a122a-22c6-4862-baf0-e6989cfae0fc service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.878232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 990/1953] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:13.879148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a122a-22c6-4862-baf0-e6989cfae0fc service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:13.880482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bb9a122a-22c6-4862-baf0-e6989cfae0fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:13.890589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c17b75725648f396e7a3baead6fb98', 'request_id': 'req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:13.897543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a122a-22c6-4862-baf0-e6989cfae0fc service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:13.898630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c17b75725648f396e7a3baead6fb98', 'request_id': 'req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:13.958161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:13.958908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:13.959268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:13.959438 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] PATH_INFO: `/v3/users/9f8f4b15264746ffac6dfa0d321b49a4` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:13.960489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c17b75725648f396e7a3baead6fb98', 'request_id': 'req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:13.960810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8f4b15264746ffac6dfa0d321b49a4)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:13.962869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:13.973689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] The token cache is being invalidate because project 19c17b75725648f396e7a3baead6fb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:13.974044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:13.975035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:13.976345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 964/1954] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:13 2022] DELETE /identity/v3/projects/19c17b75725648f396e7a3baead6fb98 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:13.977568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:13.978839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:14.025424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:14.045308 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c1b6-93ea-4a3f-9dbd-dd8a3814a60c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:14.049659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dc44b-4e2c-4a67-b4de-ffd92ca0b81d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:14.050295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dc44b-4e2c-4a67-b4de-ffd92ca0b81d service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:14.050606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dc44b-4e2c-4a67-b4de-ffd92ca0b81d service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:14.050879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dc44b-4e2c-4a67-b4de-ffd92ca0b81d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:14.052695 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b63dc44b-4e2c-4a67-b4de-ffd92ca0b81d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:14.122354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dc44b-4e2c-4a67-b4de-ffd92ca0b81d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:14.123747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dc44b-4e2c-4a67-b4de-ffd92ca0b81d service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:14.133885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 965/1955] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:13 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:14.135262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbbe61-7cc1-4373-b951-84ceb60a76d8 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:14.135542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbbe61-7cc1-4373-b951-84ceb60a76d8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:14.136353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbbe61-7cc1-4373-b951-84ceb60a76d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:14.159960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d1cbbe61-7cc1-4373-b951-84ceb60a76d8 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:14.161454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d1cbbe61-7cc1-4373-b951-84ceb60a76d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:14.171311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 966/1956] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:14.182108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902abb8-3f10-483d-abef-2ce5b6832c09 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:14.183031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902abb8-3f10-483d-abef-2ce5b6832c09 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:14.183913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902abb8-3f10-483d-abef-2ce5b6832c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:14.201608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8f4b15264746ffac6dfa0d321b49a4'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:14.202746 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8f4b15264746ffac6dfa0d321b49a4'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:14.204765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9902abb8-3f10-483d-abef-2ce5b6832c09 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:14.206205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9902abb8-3f10-483d-abef-2ce5b6832c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:14.216719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 967/1957] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:14.223211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902abb8-3f10-483d-abef-2ce5b6832c09 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:14.226172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8f4b15264746ffac6dfa0d321b49a4'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:14.236650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902abb8-3f10-483d-abef-2ce5b6832c09 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:14.243659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a3726-b548-40b8-89cf-565a76fc5bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:14.245111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3726-b548-40b8-89cf-565a76fc5bee admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:14.245511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3726-b548-40b8-89cf-565a76fc5bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:14.246632 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3726-b548-40b8-89cf-565a76fc5bee admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:14.247596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a3726-b548-40b8-89cf-565a76fc5bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:14.248081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a3726-b548-40b8-89cf-565a76fc5bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:14.251091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8f4b15264746ffac6dfa0d321b49a4'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:14.251494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a3726-b548-40b8-89cf-565a76fc5bee admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:14.266484 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 968/1958] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:14.271375 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a3726-b548-40b8-89cf-565a76fc5bee admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:14.282545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a3726-b548-40b8-89cf-565a76fc5bee admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:14.288414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c750fb-b238-43cd-aba4-77be584b6a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:14.292943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c750fb-b238-43cd-aba4-77be584b6a79 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:14.292943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c750fb-b238-43cd-aba4-77be584b6a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:14.292943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c750fb-b238-43cd-aba4-77be584b6a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:14.292943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c750fb-b238-43cd-aba4-77be584b6a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:14.292943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c750fb-b238-43cd-aba4-77be584b6a79 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:14.331711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8f4b15264746ffac6dfa0d321b49a4'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:14.342814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 991/1959] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:13 2022] DELETE /identity/v3/users/9f8f4b15264746ffac6dfa0d321b49a4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:14.441736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 969/1960] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:14 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:14.450033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:14.546712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be694c-51a2-4117-a2f1-a0a8fcbc4d94 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:14.618871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d7438-ebdf-4027-b18c-757dab72b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:14.619437 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d7438-ebdf-4027-b18c-757dab72b7fa admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:14.619816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d7438-ebdf-4027-b18c-757dab72b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:14.620295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d7438-ebdf-4027-b18c-757dab72b7fa admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:14.621375 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d7438-ebdf-4027-b18c-757dab72b7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:14.625499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d7438-ebdf-4027-b18c-757dab72b7fa admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:14.753484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 992/1961] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:14 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:14.760089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c750fb-b238-43cd-aba4-77be584b6a79 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:14.780563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c750fb-b238-43cd-aba4-77be584b6a79 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:14.792202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1af78-e245-4969-a7ef-ff6586438698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:14.793708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1af78-e245-4969-a7ef-ff6586438698 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:14.794590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1af78-e245-4969-a7ef-ff6586438698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:14.795300 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1af78-e245-4969-a7ef-ff6586438698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:14.796814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1af78-e245-4969-a7ef-ff6586438698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:14.799134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1af78-e245-4969-a7ef-ff6586438698 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:14.818220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 970/1962] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:14.828605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d7438-ebdf-4027-b18c-757dab72b7fa admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:14.842407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d7438-ebdf-4027-b18c-757dab72b7fa admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:14.844729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:14.850209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd490b-e923-4c05-ac52-ab87e8adfdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:14.850813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd490b-e923-4c05-ac52-ab87e8adfdcb admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:14.850994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd490b-e923-4c05-ac52-ab87e8adfdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:14.851277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd490b-e923-4c05-ac52-ab87e8adfdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:14.851987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd490b-e923-4c05-ac52-ab87e8adfdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:14.853615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd490b-e923-4c05-ac52-ab87e8adfdcb admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:14.865509 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 993/1963] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:14.871508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1af78-e245-4969-a7ef-ff6586438698 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:14.888501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1af78-e245-4969-a7ef-ff6586438698 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:14.894397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71086d-1eaf-43a8-8e97-386edb24d3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:14.895079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71086d-1eaf-43a8-8e97-386edb24d3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:14.895383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71086d-1eaf-43a8-8e97-386edb24d3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:14.895663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71086d-1eaf-43a8-8e97-386edb24d3f9 admin admin] PATH_INFO: `/v3/projects/d10d25a3c8ca4dc3ba31c07808a5aa57/users/39b46a0807f04d578f46b059bab13641/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:14.913670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71086d-1eaf-43a8-8e97-386edb24d3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10d25a3c8ca4dc3ba31c07808a5aa57, user_id=39b46a0807f04d578f46b059bab13641, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:14.918517 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71086d-1eaf-43a8-8e97-386edb24d3f9 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:14.968588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd490b-e923-4c05-ac52-ab87e8adfdcb admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:14.970751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d2dd490b-e923-4c05-ac52-ab87e8adfdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:14.988498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:14.988732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd490b-e923-4c05-ac52-ab87e8adfdcb admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.002685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 971/1964] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:14 2022] PUT /identity/v3/projects/d10d25a3c8ca4dc3ba31c07808a5aa57/users/39b46a0807f04d578f46b059bab13641/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:15.012251 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eec0c-025f-413d-8e10-2c365a7a889f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.012591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eec0c-025f-413d-8e10-2c365a7a889f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.013031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eec0c-025f-413d-8e10-2c365a7a889f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.048884 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8a7eec0c-025f-413d-8e10-2c365a7a889f None None] MFA Rules not processed for user `39b46a0807f04d578f46b059bab13641`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:15.050446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8a7eec0c-025f-413d-8e10-2c365a7a889f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:15.093338 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:15.094717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.097622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.097622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] PATH_INFO: `/v3/projects/54107a78c3a24967845f3683446aee45` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.097881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54107a78c3a24967845f3683446aee45)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:15.101480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:15.126341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 972/1965] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:15.132580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eec0c-025f-413d-8e10-2c365a7a889f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:15.148676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eec0c-025f-413d-8e10-2c365a7a889f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.156144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977784f7-44db-4058-8821-25114cf5dde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:15.156938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977784f7-44db-4058-8821-25114cf5dde4 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.157345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977784f7-44db-4058-8821-25114cf5dde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.157690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977784f7-44db-4058-8821-25114cf5dde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.158470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977784f7-44db-4058-8821-25114cf5dde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:15.160756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977784f7-44db-4058-8821-25114cf5dde4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:15.177646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:15.242793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54107a78c3a24967845f3683446aee45', 'request_id': 'req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:15.250258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54107a78c3a24967845f3683446aee45', 'request_id': 'req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:15.270880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:15.279529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 973/1966] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:15 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:15.283526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977784f7-44db-4058-8821-25114cf5dde4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:15.343311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54107a78c3a24967845f3683446aee45', 'request_id': 'req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:15.351330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977784f7-44db-4058-8821-25114cf5dde4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.355332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] The token cache is being invalidate because project 54107a78c3a24967845f3683446aee45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:15.355830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:15.356670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d6782e6d-4b02-42f4-bf6c-ce5d89cc85e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:15.356870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e36b6-645b-47c0-8de4-7ae531c04d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:15.357495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e36b6-645b-47c0-8de4-7ae531c04d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.357770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e36b6-645b-47c0-8de4-7ae531c04d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.358039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e36b6-645b-47c0-8de4-7ae531c04d97 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.358469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 994/1967] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:14 2022] DELETE /identity/v3/projects/54107a78c3a24967845f3683446aee45 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:15.358744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e36b6-645b-47c0-8de4-7ae531c04d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:15.360680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e36b6-645b-47c0-8de4-7ae531c04d97 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:15.363396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f994-3c03-45c4-877a-ee06022b6b79 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.363683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f994-3c03-45c4-877a-ee06022b6b79 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.363965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f994-3c03-45c4-877a-ee06022b6b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.384159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9228f994-3c03-45c4-877a-ee06022b6b79 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:15.385155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9228f994-3c03-45c4-877a-ee06022b6b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:15.394567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 995/1968] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:15.403398 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138fadf-a408-40f2-aab8-e090d2137665 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.403679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138fadf-a408-40f2-aab8-e090d2137665 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.403964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138fadf-a408-40f2-aab8-e090d2137665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.424178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-7138fadf-a408-40f2-aab8-e090d2137665 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:15.425370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7138fadf-a408-40f2-aab8-e090d2137665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:15.433459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 996/1969] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:15.437776 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138fadf-a408-40f2-aab8-e090d2137665 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:15.440523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 974/1970] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:15 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:15.447121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138fadf-a408-40f2-aab8-e090d2137665 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.450302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e36b6-645b-47c0-8de4-7ae531c04d97 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:15.452249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1e4e36b6-645b-47c0-8de4-7ae531c04d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:15.453285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99045dd-f92c-40fb-b504-498f30b70bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:15.453910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99045dd-f92c-40fb-b504-498f30b70bba admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.454182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99045dd-f92c-40fb-b504-498f30b70bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.454487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99045dd-f92c-40fb-b504-498f30b70bba admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.455445 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99045dd-f92c-40fb-b504-498f30b70bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:15.455748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99045dd-f92c-40fb-b504-498f30b70bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:15.457347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99045dd-f92c-40fb-b504-498f30b70bba admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:15.465825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e36b6-645b-47c0-8de4-7ae531c04d97 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.470649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546ae79-ed2d-4d67-b0c8-931a69b22823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:15.471268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546ae79-ed2d-4d67-b0c8-931a69b22823 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.471546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546ae79-ed2d-4d67-b0c8-931a69b22823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.471820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546ae79-ed2d-4d67-b0c8-931a69b22823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.476872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 997/1971] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:26:15.476991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546ae79-ed2d-4d67-b0c8-931a69b22823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:15.476991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546ae79-ed2d-4d67-b0c8-931a69b22823 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:15.480803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99045dd-f92c-40fb-b504-498f30b70bba admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:15.486164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 975/1972] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:15.491036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546ae79-ed2d-4d67-b0c8-931a69b22823 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:15.491397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99045dd-f92c-40fb-b504-498f30b70bba admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.497311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d57d-e5fa-4647-8a28-78b5456c52cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:15.497908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d57d-e5fa-4647-8a28-78b5456c52cd admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.498188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d57d-e5fa-4647-8a28-78b5456c52cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.498497 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d57d-e5fa-4647-8a28-78b5456c52cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.499179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016d57d-e5fa-4647-8a28-78b5456c52cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:15.501170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016d57d-e5fa-4647-8a28-78b5456c52cd admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:15.503732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546ae79-ed2d-4d67-b0c8-931a69b22823 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.506420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:15.512761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36379f5f-0396-48da-bd5c-b302fd83d0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:15.513500 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379f5f-0396-48da-bd5c-b302fd83d0c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.513594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379f5f-0396-48da-bd5c-b302fd83d0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.513835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379f5f-0396-48da-bd5c-b302fd83d0c7 admin admin] PATH_INFO: `/v3/projects/0492ebf378574162af54a809508b436b/users/04fabe4ed6e149c9b4f6f28750c7d124/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.532443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36379f5f-0396-48da-bd5c-b302fd83d0c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0492ebf378574162af54a809508b436b, user_id=04fabe4ed6e149c9b4f6f28750c7d124, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:15.535458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36379f5f-0396-48da-bd5c-b302fd83d0c7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:15.537453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:15.627313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 998/1973] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:15 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:15.631550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d57d-e5fa-4647-8a28-78b5456c52cd admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:15.655169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 976/1974] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:15 2022] PUT /identity/v3/projects/0492ebf378574162af54a809508b436b/users/04fabe4ed6e149c9b4f6f28750c7d124/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:15.659342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36379f5f-0396-48da-bd5c-b302fd83d0c7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:15.726593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d57d-e5fa-4647-8a28-78b5456c52cd admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.783282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36379f5f-0396-48da-bd5c-b302fd83d0c7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.799900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137fbc7-7a48-4754-b586-85b1dfb707a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:15.800995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137fbc7-7a48-4754-b586-85b1dfb707a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.801797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137fbc7-7a48-4754-b586-85b1dfb707a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.802159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137fbc7-7a48-4754-b586-85b1dfb707a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.802938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137fbc7-7a48-4754-b586-85b1dfb707a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:15.815604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:15.815604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137fbc7-7a48-4754-b586-85b1dfb707a1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:15.815896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631c864-3663-49a0-9aad-1c9c9abd287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:15.815896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631c864-3663-49a0-9aad-1c9c9abd287c admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.815896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631c864-3663-49a0-9aad-1c9c9abd287c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.815896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631c864-3663-49a0-9aad-1c9c9abd287c admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.816453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631c864-3663-49a0-9aad-1c9c9abd287c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:15.817927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631c864-3663-49a0-9aad-1c9c9abd287c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:15.822542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 977/1975] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:15.828116 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137fbc7-7a48-4754-b586-85b1dfb707a1 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:15.835060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:15.841171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137fbc7-7a48-4754-b586-85b1dfb707a1 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.846141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d316c8-87ea-4964-9070-359900ce85a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:15.846898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d316c8-87ea-4964-9070-359900ce85a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.847174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d316c8-87ea-4964-9070-359900ce85a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.847447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d316c8-87ea-4964-9070-359900ce85a6 admin admin] PATH_INFO: `/v3/projects/0492ebf378574162af54a809508b436b/users/04fabe4ed6e149c9b4f6f28750c7d124/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.849534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d316c8-87ea-4964-9070-359900ce85a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0492ebf378574162af54a809508b436b, user_id=04fabe4ed6e149c9b4f6f28750c7d124, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:15.852241 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d316c8-87ea-4964-9070-359900ce85a6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:15.864976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 978/1976] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:15 2022] PUT /identity/v3/projects/0492ebf378574162af54a809508b436b/users/04fabe4ed6e149c9b4f6f28750c7d124/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:15.878957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9ef2-e6f7-4490-b799-62fed20df186 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:15.879245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9ef2-e6f7-4490-b799-62fed20df186 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:15.879524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9ef2-e6f7-4490-b799-62fed20df186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:15.910951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-778a9ef2-e6f7-4490-b799-62fed20df186 None None] MFA Rules not processed for user `04fabe4ed6e149c9b4f6f28750c7d124`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:15.912228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-778a9ef2-e6f7-4490-b799-62fed20df186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:15.926702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 999/1977] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:15 2022] POST /identity/v3/users => generated 287 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:15.931190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631c864-3663-49a0-9aad-1c9c9abd287c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:15.945807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631c864-3663-49a0-9aad-1c9c9abd287c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:15.996430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 979/1978] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:16.008466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a9ef2-e6f7-4490-b799-62fed20df186 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:16.010205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-778a9ef2-e6f7-4490-b799-62fed20df186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:16.037098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4498d52-74bf-4833-8da7-519c1561de00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:16.037999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498d52-74bf-4833-8da7-519c1561de00 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:16.038285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498d52-74bf-4833-8da7-519c1561de00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:16.038642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498d52-74bf-4833-8da7-519c1561de00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:16.039597 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4498d52-74bf-4833-8da7-519c1561de00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:16.041915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4498d52-74bf-4833-8da7-519c1561de00 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:16.060508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1000/1979] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:16.064958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4498d52-74bf-4833-8da7-519c1561de00 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:16.080339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4498d52-74bf-4833-8da7-519c1561de00 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:16.092459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aaca3-b8e5-42a1-b345-ffe809b58ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:16.092762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a9ef2-e6f7-4490-b799-62fed20df186 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:16.093435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aaca3-b8e5-42a1-b345-ffe809b58ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:16.094940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aaca3-b8e5-42a1-b345-ffe809b58ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:16.094940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aaca3-b8e5-42a1-b345-ffe809b58ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:16.095710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aaca3-b8e5-42a1-b345-ffe809b58ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:16.098778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aaca3-b8e5-42a1-b345-ffe809b58ab3 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:16.099041 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89938eb8-dce1-4ae6-9a8c-8e1495731266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:16.099928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89938eb8-dce1-4ae6-9a8c-8e1495731266 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:16.100435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89938eb8-dce1-4ae6-9a8c-8e1495731266 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:16.101060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89938eb8-dce1-4ae6-9a8c-8e1495731266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:16.117818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1001/1980] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:16.119416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89938eb8-dce1-4ae6-9a8c-8e1495731266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:16.122265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89938eb8-dce1-4ae6-9a8c-8e1495731266 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:16.125382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aaca3-b8e5-42a1-b345-ffe809b58ab3 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:16.141331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 980/1981] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:16.142833 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aaca3-b8e5-42a1-b345-ffe809b58ab3 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:16.163767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2c78-98ec-4a71-bdad-2d898ecc0027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:16.163767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2c78-98ec-4a71-bdad-2d898ecc0027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:16.163767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2c78-98ec-4a71-bdad-2d898ecc0027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:16.163767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2c78-98ec-4a71-bdad-2d898ecc0027 admin admin] PATH_INFO: `/v3/projects/08fdded0af804b53a8bb8cc7d7d1a8d2/users/dea93c6c505c48639d500a778c232347/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:16.183874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2c78-98ec-4a71-bdad-2d898ecc0027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08fdded0af804b53a8bb8cc7d7d1a8d2, user_id=dea93c6c505c48639d500a778c232347, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:16.184685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2c78-98ec-4a71-bdad-2d898ecc0027 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:16.383387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1002/1982] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:16 2022] PUT /identity/v3/projects/08fdded0af804b53a8bb8cc7d7d1a8d2/users/dea93c6c505c48639d500a778c232347/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:16.389207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016efa63-c37c-481c-b461-aac6331b93ff None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:16.389510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016efa63-c37c-481c-b461-aac6331b93ff None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:16.389784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016efa63-c37c-481c-b461-aac6331b93ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:16.411690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-016efa63-c37c-481c-b461-aac6331b93ff None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:16.412910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-016efa63-c37c-481c-b461-aac6331b93ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:16.417753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:16.478501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 981/1983] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:16.488726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2c78-98ec-4a71-bdad-2d898ecc0027 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:16.490538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d06f2c78-98ec-4a71-bdad-2d898ecc0027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:16.552118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2c78-98ec-4a71-bdad-2d898ecc0027 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:16.555978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bffbe-8a89-47d7-96a6-c7205efc8039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:16.556603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bffbe-8a89-47d7-96a6-c7205efc8039 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:16.556888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bffbe-8a89-47d7-96a6-c7205efc8039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:16.557684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bffbe-8a89-47d7-96a6-c7205efc8039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:16.568549 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bffbe-8a89-47d7-96a6-c7205efc8039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:16.569995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bffbe-8a89-47d7-96a6-c7205efc8039 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:16.582533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1003/1984] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:16.584785 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016efa63-c37c-481c-b461-aac6331b93ff None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:16.649592 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016efa63-c37c-481c-b461-aac6331b93ff None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:16.653536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3184c-64b1-4315-ac11-5afc1e773f3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:16.654178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3184c-64b1-4315-ac11-5afc1e773f3b service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:16.654492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3184c-64b1-4315-ac11-5afc1e773f3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:16.654770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3184c-64b1-4315-ac11-5afc1e773f3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:16.656657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-94d3184c-64b1-4315-ac11-5afc1e773f3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:16.724135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3184c-64b1-4315-ac11-5afc1e773f3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:16.725726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3184c-64b1-4315-ac11-5afc1e773f3b service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:16.737065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 982/1985] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:18.085321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff095-8f31-4976-a94e-52dfc2155c9f None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.085878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff095-8f31-4976-a94e-52dfc2155c9f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.085991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff095-8f31-4976-a94e-52dfc2155c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.130631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-27eff095-8f31-4976-a94e-52dfc2155c9f None None] MFA Rules not processed for user `dea93c6c505c48639d500a778c232347`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:18.132090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-27eff095-8f31-4976-a94e-52dfc2155c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:18.138195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:18.249079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1004/1986] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:18.256561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3184c-64b1-4315-ac11-5afc1e773f3b service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:18.271066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3184c-64b1-4315-ac11-5afc1e773f3b service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:18.296212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda8d4b-3578-4463-a32c-dc37ef2c444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:18.296659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8d4b-3578-4463-a32c-dc37ef2c444d admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.297132 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8d4b-3578-4463-a32c-dc37ef2c444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.297413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8d4b-3578-4463-a32c-dc37ef2c444d admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.298091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda8d4b-3578-4463-a32c-dc37ef2c444d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:18.300078 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda8d4b-3578-4463-a32c-dc37ef2c444d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:18.400390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 983/1987] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:18 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:18.401648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff095-8f31-4976-a94e-52dfc2155c9f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:18.418605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff095-8f31-4976-a94e-52dfc2155c9f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:18.518832 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073035f1-7dc5-41c0-9601-1f88511eec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:18.519572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073035f1-7dc5-41c0-9601-1f88511eec4a admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.519936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073035f1-7dc5-41c0-9601-1f88511eec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.520206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073035f1-7dc5-41c0-9601-1f88511eec4a admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.520874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073035f1-7dc5-41c0-9601-1f88511eec4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:18.523007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073035f1-7dc5-41c0-9601-1f88511eec4a admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:18.630011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1005/1988] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:18 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:18.634259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda8d4b-3578-4463-a32c-dc37ef2c444d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:18.646872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda8d4b-3578-4463-a32c-dc37ef2c444d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:18.653933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aa0d2-64b0-49ad-b871-d2617d702ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:18.654791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa0d2-64b0-49ad-b871-d2617d702ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.658164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa0d2-64b0-49ad-b871-d2617d702ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.658164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa0d2-64b0-49ad-b871-d2617d702ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.658164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aa0d2-64b0-49ad-b871-d2617d702ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:18.658164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aa0d2-64b0-49ad-b871-d2617d702ac0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:18.671664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 984/1989] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:18.676655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073035f1-7dc5-41c0-9601-1f88511eec4a admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:18.694122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073035f1-7dc5-41c0-9601-1f88511eec4a admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:18.700094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a6480-8d3c-473e-804d-f2bbdd72fce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:18.700831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a6480-8d3c-473e-804d-f2bbdd72fce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.701105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a6480-8d3c-473e-804d-f2bbdd72fce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.701792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a6480-8d3c-473e-804d-f2bbdd72fce0 admin admin] PATH_INFO: `/v3/projects/d5e7777eec2c4a81b86d322dd969dc4a/users/65fd64ecce71489d8ccf0d5e74a9ce43/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.720802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a6480-8d3c-473e-804d-f2bbdd72fce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e7777eec2c4a81b86d322dd969dc4a, user_id=65fd64ecce71489d8ccf0d5e74a9ce43, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:18.723849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a6480-8d3c-473e-804d-f2bbdd72fce0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:18.816529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1006/1990] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:18 2022] PUT /identity/v3/projects/d5e7777eec2c4a81b86d322dd969dc4a/users/65fd64ecce71489d8ccf0d5e74a9ce43/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:18.818826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aa0d2-64b0-49ad-b871-d2617d702ac0 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:18.841414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aa0d2-64b0-49ad-b871-d2617d702ac0 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:18.885265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:18.922442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f7aa-40de-498d-b4e8-779dd7a5899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:18.923553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f7aa-40de-498d-b4e8-779dd7a5899a admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.924067 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f7aa-40de-498d-b4e8-779dd7a5899a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.924572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f7aa-40de-498d-b4e8-779dd7a5899a admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.925954 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11f7aa-40de-498d-b4e8-779dd7a5899a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:18.928663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11f7aa-40de-498d-b4e8-779dd7a5899a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:18.940237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 985/1991] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:18.945562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a6480-8d3c-473e-804d-f2bbdd72fce0 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:18.957527 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a6480-8d3c-473e-804d-f2bbdd72fce0 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:18.962945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426b56b-6229-4cb1-9329-44ff890c2e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:18.964172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426b56b-6229-4cb1-9329-44ff890c2e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.964677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426b56b-6229-4cb1-9329-44ff890c2e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.964959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426b56b-6229-4cb1-9329-44ff890c2e0d admin admin] PATH_INFO: `/v3/projects/d5e7777eec2c4a81b86d322dd969dc4a/users/65fd64ecce71489d8ccf0d5e74a9ce43/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.967066 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426b56b-6229-4cb1-9329-44ff890c2e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e7777eec2c4a81b86d322dd969dc4a, user_id=65fd64ecce71489d8ccf0d5e74a9ce43, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:18.969779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426b56b-6229-4cb1-9329-44ff890c2e0d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:18.981601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1007/1992] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:18 2022] PUT /identity/v3/projects/d5e7777eec2c4a81b86d322dd969dc4a/users/65fd64ecce71489d8ccf0d5e74a9ce43/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:19.420779 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f7aa-40de-498d-b4e8-779dd7a5899a admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:19.422846 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5d11f7aa-40de-498d-b4e8-779dd7a5899a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:19.450968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f7aa-40de-498d-b4e8-779dd7a5899a admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:19.547508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:19.548702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:19.548702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:19.549019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] PATH_INFO: `/v3/users/f640b3dbbc63464c8ae2b18817e633a6` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:19.550162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f640b3dbbc63464c8ae2b18817e633a6)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:19.553047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:19.765969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f640b3dbbc63464c8ae2b18817e633a6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:19.767048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f640b3dbbc63464c8ae2b18817e633a6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:19.779074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f640b3dbbc63464c8ae2b18817e633a6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:19.779962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f640b3dbbc63464c8ae2b18817e633a6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:19.860365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f640b3dbbc63464c8ae2b18817e633a6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:19.883107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 986/1993] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:19 2022] DELETE /identity/v3/users/f640b3dbbc63464c8ae2b18817e633a6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:19.890424 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a8637-40d0-431f-af03-5a14854fd7cb None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:19.891068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a8637-40d0-431f-af03-5a14854fd7cb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:19.891068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a8637-40d0-431f-af03-5a14854fd7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:19.911624 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-7e5a8637-40d0-431f-af03-5a14854fd7cb None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:19.912847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7e5a8637-40d0-431f-af03-5a14854fd7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:19.985836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:19.998485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1008/1994] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:20.010611 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:20.012157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:20.081294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:20.089017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d74ca-a3fb-413d-b293-c088ac6ee85e admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:20.093970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175ce30-549e-411e-bd23-8dc612d68a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:20.099259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175ce30-549e-411e-bd23-8dc612d68a41 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:20.099259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175ce30-549e-411e-bd23-8dc612d68a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:20.099259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175ce30-549e-411e-bd23-8dc612d68a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:20.108211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175ce30-549e-411e-bd23-8dc612d68a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:20.109919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175ce30-549e-411e-bd23-8dc612d68a41 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:20.122012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 987/1995] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:20.609942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab418f-3d34-4e9b-93c6-d91b21621c97 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:20.610589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab418f-3d34-4e9b-93c6-d91b21621c97 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:20.611078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab418f-3d34-4e9b-93c6-d91b21621c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:20.687394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-bdab418f-3d34-4e9b-93c6-d91b21621c97 None None] MFA Rules not processed for user `65fd64ecce71489d8ccf0d5e74a9ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:20.692575 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bdab418f-3d34-4e9b-93c6-d91b21621c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:20.712741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175ce30-549e-411e-bd23-8dc612d68a41 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:20.717152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4175ce30-549e-411e-bd23-8dc612d68a41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:20.747945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175ce30-549e-411e-bd23-8dc612d68a41 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:20.754277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:20.755287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:20.756168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:20.756638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] PATH_INFO: `/v3/projects/671028c2e017478ca491fb8073355ddc` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:20.758616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=671028c2e017478ca491fb8073355ddc)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:20.762540 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:20.814077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1009/1996] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:20.932374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab418f-3d34-4e9b-93c6-d91b21621c97 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:20.934663 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bdab418f-3d34-4e9b-93c6-d91b21621c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:20.953206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671028c2e017478ca491fb8073355ddc', 'request_id': 'req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:20.975323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671028c2e017478ca491fb8073355ddc', 'request_id': 'req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:21.020277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab418f-3d34-4e9b-93c6-d91b21621c97 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:21.079447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4e3ad-7539-4f15-8e06-f747305c2482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:21.080152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4e3ad-7539-4f15-8e06-f747305c2482 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:21.080287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671028c2e017478ca491fb8073355ddc', 'request_id': 'req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:21.080468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4e3ad-7539-4f15-8e06-f747305c2482 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:21.080766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4e3ad-7539-4f15-8e06-f747305c2482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:21.083869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-dac4e3ad-7539-4f15-8e06-f747305c2482 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:21.095301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] The token cache is being invalidate because project 671028c2e017478ca491fb8073355ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:21.095580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:21.096274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:21.101702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 988/1997] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:20 2022] DELETE /identity/v3/projects/671028c2e017478ca491fb8073355ddc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:21.103899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:21.106260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:21.184109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:21.185505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4e3ad-7539-4f15-8e06-f747305c2482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:21.187801 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4e3ad-7539-4f15-8e06-f747305c2482 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:21.200044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1010/1998] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:21.231331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c69c7-f0a4-4ac8-9f0a-3bbc8b6e45ce admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:21.241323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:21.248594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:21.248594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:21.248594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] PATH_INFO: `/v3/users/964c085465164ed3a34f12129ebddbcd` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:21.248594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964c085465164ed3a34f12129ebddbcd)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:21.250827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:21.484701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964c085465164ed3a34f12129ebddbcd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:21.485364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964c085465164ed3a34f12129ebddbcd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:21.501817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964c085465164ed3a34f12129ebddbcd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:21.502788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964c085465164ed3a34f12129ebddbcd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:21.611470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d2308d65-13ad-4fbf-b4af-d27a9c8c59d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964c085465164ed3a34f12129ebddbcd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:21.621547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:21.633591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 989/1999] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:21 2022] DELETE /identity/v3/users/964c085465164ed3a34f12129ebddbcd => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:22.107058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4e3ad-7539-4f15-8e06-f747305c2482 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:22.121713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4e3ad-7539-4f15-8e06-f747305c2482 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:22.217668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:22.218235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:22.218570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:22.218842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] PATH_INFO: `/v3/projects/2207b2b32e444294bc4cb512c75fcb7c` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:22.219991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2207b2b32e444294bc4cb512c75fcb7c)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:22.222054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:22.355571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2207b2b32e444294bc4cb512c75fcb7c', 'request_id': 'req-ad8b80c1-6881-43cb-869a-7842052e8d82'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:22.362287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2207b2b32e444294bc4cb512c75fcb7c', 'request_id': 'req-ad8b80c1-6881-43cb-869a-7842052e8d82'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:22.442212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2207b2b32e444294bc4cb512c75fcb7c', 'request_id': 'req-ad8b80c1-6881-43cb-869a-7842052e8d82'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:22.460053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] The token cache is being invalidate because project 2207b2b32e444294bc4cb512c75fcb7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:22.460563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:22.464755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:22.468942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1011/2000] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:22 2022] DELETE /identity/v3/projects/2207b2b32e444294bc4cb512c75fcb7c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:22.473531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2005db4-5f73-46b6-86e5-7fc679cddfeb None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:22.474000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2005db4-5f73-46b6-86e5-7fc679cddfeb None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:22.474128 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2005db4-5f73-46b6-86e5-7fc679cddfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:22.479019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:22.480932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:22.499554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d2005db4-5f73-46b6-86e5-7fc679cddfeb None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:22.501044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d2005db4-5f73-46b6-86e5-7fc679cddfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:22.589733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 990/2001] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:22.589890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b80c1-6881-43cb-869a-7842052e8d82 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:22.592744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:22.593555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:22.593996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:22.594332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed195b-337f-4e28-b5c4-a2e6579e957d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:22.594610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] PATH_INFO: `/v3/users/d55e7d33d9e34f32852496dbf63e18c9` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:22.594928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed195b-337f-4e28-b5c4-a2e6579e957d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:22.595094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed195b-337f-4e28-b5c4-a2e6579e957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:22.597268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55e7d33d9e34f32852496dbf63e18c9)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:22.601021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:22.622181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-28ed195b-337f-4e28-b5c4-a2e6579e957d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:22.623446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-28ed195b-337f-4e28-b5c4-a2e6579e957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:22.632017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 991/2002] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:22.637150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed195b-337f-4e28-b5c4-a2e6579e957d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:22.647446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed195b-337f-4e28-b5c4-a2e6579e957d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:22.653251 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281dba1-636a-4a6c-a7c7-163a887bb8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:22.653850 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281dba1-636a-4a6c-a7c7-163a887bb8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:22.654129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281dba1-636a-4a6c-a7c7-163a887bb8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:22.654518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281dba1-636a-4a6c-a7c7-163a887bb8d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:22.655231 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281dba1-636a-4a6c-a7c7-163a887bb8d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:22.655533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281dba1-636a-4a6c-a7c7-163a887bb8d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:22.657133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281dba1-636a-4a6c-a7c7-163a887bb8d8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:22.669166 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 992/2003] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:26:22.673760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281dba1-636a-4a6c-a7c7-163a887bb8d8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:22.684622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281dba1-636a-4a6c-a7c7-163a887bb8d8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:22.689759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cea48-4464-46a1-83fd-065c607d9025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:22.690396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cea48-4464-46a1-83fd-065c607d9025 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:22.690677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cea48-4464-46a1-83fd-065c607d9025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:22.690951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cea48-4464-46a1-83fd-065c607d9025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:22.691820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cea48-4464-46a1-83fd-065c607d9025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:22.693942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cea48-4464-46a1-83fd-065c607d9025 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:22.790727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:22.813783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 993/2004] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:22 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:22.817363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cea48-4464-46a1-83fd-065c607d9025 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:22.887547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cea48-4464-46a1-83fd-065c607d9025 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:22.892405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49a412-2719-4f50-917d-94631fbe91f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:22.893039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49a412-2719-4f50-917d-94631fbe91f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:22.893344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49a412-2719-4f50-917d-94631fbe91f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:22.893618 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49a412-2719-4f50-917d-94631fbe91f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:22.894485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49a412-2719-4f50-917d-94631fbe91f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:22.896457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49a412-2719-4f50-917d-94631fbe91f6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:22.929315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55e7d33d9e34f32852496dbf63e18c9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:22.929977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55e7d33d9e34f32852496dbf63e18c9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:22.938653 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55e7d33d9e34f32852496dbf63e18c9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:22.951435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55e7d33d9e34f32852496dbf63e18c9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:23.006525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 994/2005] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:22 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:23.012024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49a412-2719-4f50-917d-94631fbe91f6 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.014409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1d49a412-2719-4f50-917d-94631fbe91f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:23.028104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49a412-2719-4f50-917d-94631fbe91f6 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.028345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3be39f91-3093-4ad7-89d4-73a23a8d99c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55e7d33d9e34f32852496dbf63e18c9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:23.033258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3899-f997-497c-a17f-e1726347ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.033896 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3899-f997-497c-a17f-e1726347ec26 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.034159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3899-f997-497c-a17f-e1726347ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.034463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3899-f997-497c-a17f-e1726347ec26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.035215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1012/2006] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:22 2022] DELETE /identity/v3/users/d55e7d33d9e34f32852496dbf63e18c9 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:23.035417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba3899-f997-497c-a17f-e1726347ec26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:23.037017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba3899-f997-497c-a17f-e1726347ec26 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:23.040109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a9edb-3c70-4c0d-9253-c2839c4deb4a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.040393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a9edb-3c70-4c0d-9253-c2839c4deb4a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.040674 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a9edb-3c70-4c0d-9253-c2839c4deb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.049112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 995/2007] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:23.053257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3899-f997-497c-a17f-e1726347ec26 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.062972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b13a9edb-3c70-4c0d-9253-c2839c4deb4a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:23.064366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b13a9edb-3c70-4c0d-9253-c2839c4deb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:23.064492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3899-f997-497c-a17f-e1726347ec26 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.136877 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1013/2008] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:23.138836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98beec7-86ad-45a4-a34d-e5e7432addb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.139591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98beec7-86ad-45a4-a34d-e5e7432addb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.142619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98beec7-86ad-45a4-a34d-e5e7432addb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.142929 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98beec7-86ad-45a4-a34d-e5e7432addb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.143673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98beec7-86ad-45a4-a34d-e5e7432addb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:23.147151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a9edb-3c70-4c0d-9253-c2839c4deb4a None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.147661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98beec7-86ad-45a4-a34d-e5e7432addb6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:23.148585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b13a9edb-3c70-4c0d-9253-c2839c4deb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:23.159085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 996/2009] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:23.163663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98beec7-86ad-45a4-a34d-e5e7432addb6 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.176390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98beec7-86ad-45a4-a34d-e5e7432addb6 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.181825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165732c2-fe4f-46cc-bb31-1a7d59d86a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.183330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165732c2-fe4f-46cc-bb31-1a7d59d86a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.183758 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165732c2-fe4f-46cc-bb31-1a7d59d86a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.184038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165732c2-fe4f-46cc-bb31-1a7d59d86a42 admin admin] PATH_INFO: `/v3/projects/93c2235e14c4442ab798372ce8d6680b/users/f8ca21ca12014994ac45c18821b125f5/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.200307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165732c2-fe4f-46cc-bb31-1a7d59d86a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c2235e14c4442ab798372ce8d6680b, user_id=f8ca21ca12014994ac45c18821b125f5, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:23.203293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165732c2-fe4f-46cc-bb31-1a7d59d86a42 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:23.226938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a9edb-3c70-4c0d-9253-c2839c4deb4a None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.232567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb102fb-1a3e-469b-987c-9c815e092b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.233181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb102fb-1a3e-469b-987c-9c815e092b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.233641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb102fb-1a3e-469b-987c-9c815e092b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.233871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb102fb-1a3e-469b-987c-9c815e092b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.244076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb102fb-1a3e-469b-987c-9c815e092b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:23.246785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb102fb-1a3e-469b-987c-9c815e092b98 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:23.257278 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1014/2010] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:23.262381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb102fb-1a3e-469b-987c-9c815e092b98 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.264059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7fb102fb-1a3e-469b-987c-9c815e092b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:23.275660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 997/2011] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:23 2022] PUT /identity/v3/projects/93c2235e14c4442ab798372ce8d6680b/users/f8ca21ca12014994ac45c18821b125f5/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:23.278347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:23.294447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc8de-32ab-4f80-953a-2b7bd031daa0 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.294658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc8de-32ab-4f80-953a-2b7bd031daa0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.295968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc8de-32ab-4f80-953a-2b7bd031daa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.335680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-686fc8de-32ab-4f80-953a-2b7bd031daa0 None None] MFA Rules not processed for user `f8ca21ca12014994ac45c18821b125f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:23.337668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-686fc8de-32ab-4f80-953a-2b7bd031daa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:23.367948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb102fb-1a3e-469b-987c-9c815e092b98 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.428606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 998/2012] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:23.437059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fc8de-32ab-4f80-953a-2b7bd031daa0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.452522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6cedd-bcaa-49bf-ac79-d7bb9b56cb5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.453146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6cedd-bcaa-49bf-ac79-d7bb9b56cb5d service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.453424 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6cedd-bcaa-49bf-ac79-d7bb9b56cb5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.453697 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6cedd-bcaa-49bf-ac79-d7bb9b56cb5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.455585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-fed6cedd-bcaa-49bf-ac79-d7bb9b56cb5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:23.519745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fc8de-32ab-4f80-953a-2b7bd031daa0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.525191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3013aa-caab-4a19-ad66-6eb6f6ade920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.526039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3013aa-caab-4a19-ad66-6eb6f6ade920 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.526609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3013aa-caab-4a19-ad66-6eb6f6ade920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.527013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3013aa-caab-4a19-ad66-6eb6f6ade920 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.527801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3013aa-caab-4a19-ad66-6eb6f6ade920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:23.529943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3013aa-caab-4a19-ad66-6eb6f6ade920 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:23.561653 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6cedd-bcaa-49bf-ac79-d7bb9b56cb5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:23.563380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6cedd-bcaa-49bf-ac79-d7bb9b56cb5d service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:23.580334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1015/2013] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:23.632036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 999/2014] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:23 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:23.637125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6cedd-bcaa-49bf-ac79-d7bb9b56cb5d service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.649762 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6cedd-bcaa-49bf-ac79-d7bb9b56cb5d service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.738730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe4142-4c8d-4960-8c00-9934f4926236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.739374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe4142-4c8d-4960-8c00-9934f4926236 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.739651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe4142-4c8d-4960-8c00-9934f4926236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.739921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe4142-4c8d-4960-8c00-9934f4926236 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.740589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe4142-4c8d-4960-8c00-9934f4926236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:23.742741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe4142-4c8d-4960-8c00-9934f4926236 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:23.859187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3013aa-caab-4a19-ad66-6eb6f6ade920 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.861491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2a3013aa-caab-4a19-ad66-6eb6f6ade920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:23.880304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3013aa-caab-4a19-ad66-6eb6f6ade920 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.886115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.886894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.887805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.887805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] PATH_INFO: `/v3/projects/76e83486a2dd4c8c98ad83561c3bc3a1` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.889046 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1016/2015] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:23 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:23.892111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e83486a2dd4c8c98ad83561c3bc3a1)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:23.894499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:23.904204 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe4142-4c8d-4960-8c00-9934f4926236 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.917891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe4142-4c8d-4960-8c00-9934f4926236 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.922818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416a115-3795-4e89-a121-ea1e0eee37ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.923512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a115-3795-4e89-a121-ea1e0eee37ae admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.923791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a115-3795-4e89-a121-ea1e0eee37ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.924060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a115-3795-4e89-a121-ea1e0eee37ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.924786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416a115-3795-4e89-a121-ea1e0eee37ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:23.926405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416a115-3795-4e89-a121-ea1e0eee37ae admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:23.937254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1017/2016] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:23.941463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416a115-3795-4e89-a121-ea1e0eee37ae admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.951701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416a115-3795-4e89-a121-ea1e0eee37ae admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.956550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2927367-d1c1-420b-a25b-397cb4cd6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.957154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927367-d1c1-420b-a25b-397cb4cd6b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.957434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927367-d1c1-420b-a25b-397cb4cd6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.957702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927367-d1c1-420b-a25b-397cb4cd6b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:23.958444 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2927367-d1c1-420b-a25b-397cb4cd6b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:23.960134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2927367-d1c1-420b-a25b-397cb4cd6b91 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:23.971934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1018/2017] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:23.976196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2927367-d1c1-420b-a25b-397cb4cd6b91 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:23.987313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2927367-d1c1-420b-a25b-397cb4cd6b91 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:23.992280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959e172-4529-4a1a-8eb8-87977d179170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:23.993096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e172-4529-4a1a-8eb8-87977d179170 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:23.993371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e172-4529-4a1a-8eb8-87977d179170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:23.993637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e172-4529-4a1a-8eb8-87977d179170 admin admin] PATH_INFO: `/v3/projects/73db2abed4b3487898a2efe112130f72/users/58e862dabc6940b08f1f41b406fcef95/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:24.011868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959e172-4529-4a1a-8eb8-87977d179170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73db2abed4b3487898a2efe112130f72, user_id=58e862dabc6940b08f1f41b406fcef95, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:24.014603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959e172-4529-4a1a-8eb8-87977d179170 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:24.019295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:24.024888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e83486a2dd4c8c98ad83561c3bc3a1', 'request_id': 'req-05c89990-c6e4-4457-80d2-0fe3775331ec'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:24.032355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e83486a2dd4c8c98ad83561c3bc3a1', 'request_id': 'req-05c89990-c6e4-4457-80d2-0fe3775331ec'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:24.097201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e83486a2dd4c8c98ad83561c3bc3a1', 'request_id': 'req-05c89990-c6e4-4457-80d2-0fe3775331ec'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:24.103571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1019/2018] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:23 2022] PUT /identity/v3/projects/73db2abed4b3487898a2efe112130f72/users/58e862dabc6940b08f1f41b406fcef95/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:24.110222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] The token cache is being invalidate because project 76e83486a2dd4c8c98ad83561c3bc3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:24.110567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:24.111231 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:24.112818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1000/2019] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:23 2022] DELETE /identity/v3/projects/76e83486a2dd4c8c98ad83561c3bc3a1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:24.116623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:24.117895 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9f140-757a-4744-8797-2bd7a5af6745 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:24.117895 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9f140-757a-4744-8797-2bd7a5af6745 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:24.118507 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:24.124279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9f140-757a-4744-8797-2bd7a5af6745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:24.175144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-6ff9f140-757a-4744-8797-2bd7a5af6745 None None] MFA Rules not processed for user `58e862dabc6940b08f1f41b406fcef95`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:24.179554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6ff9f140-757a-4744-8797-2bd7a5af6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:24.218812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c89990-c6e4-4457-80d2-0fe3775331ec admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:24.255104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1020/2020] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:24.259628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9f140-757a-4744-8797-2bd7a5af6745 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:24.261086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6ff9f140-757a-4744-8797-2bd7a5af6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:24.293406 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:24.294082 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:24.294387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:24.295894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] PATH_INFO: `/v3/users/23c20db8f9994bcba4f24ad5a283ee55` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:24.297250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c20db8f9994bcba4f24ad5a283ee55)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:24.299311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:24.356179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9f140-757a-4744-8797-2bd7a5af6745 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:24.364296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714ece3-53c8-4274-89e3-699f92383365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:24.365518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714ece3-53c8-4274-89e3-699f92383365 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:24.366003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714ece3-53c8-4274-89e3-699f92383365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:24.366541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714ece3-53c8-4274-89e3-699f92383365 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:24.367813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714ece3-53c8-4274-89e3-699f92383365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:24.372254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714ece3-53c8-4274-89e3-699f92383365 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:24.443679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:24.518981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1021/2021] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:24 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:24.522147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714ece3-53c8-4274-89e3-699f92383365 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:24.556182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c20db8f9994bcba4f24ad5a283ee55'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:24.558552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c20db8f9994bcba4f24ad5a283ee55'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:24.569054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c20db8f9994bcba4f24ad5a283ee55'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:24.570114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c20db8f9994bcba4f24ad5a283ee55'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:24.615860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714ece3-53c8-4274-89e3-699f92383365 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:24.622678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b7054-b297-4e25-ac28-591fd9cd0b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:24.622678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b7054-b297-4e25-ac28-591fd9cd0b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:24.622678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b7054-b297-4e25-ac28-591fd9cd0b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:24.623320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b7054-b297-4e25-ac28-591fd9cd0b3f admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:24.623675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b7054-b297-4e25-ac28-591fd9cd0b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:24.625616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b7054-b297-4e25-ac28-591fd9cd0b3f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:24.651282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c20db8f9994bcba4f24ad5a283ee55'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:24.672401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1001/2022] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:24 2022] DELETE /identity/v3/users/23c20db8f9994bcba4f24ad5a283ee55 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:24.742025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1022/2023] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:24 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:24.743736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:24.751872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:24.858284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9bbf4-3013-473d-ba90-53e087eecc71 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:24.865369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c69868-3c15-434e-87f2-aba60e86d27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:24.869397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c69868-3c15-434e-87f2-aba60e86d27f admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:24.869397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c69868-3c15-434e-87f2-aba60e86d27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:24.869397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c69868-3c15-434e-87f2-aba60e86d27f admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:24.869397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c69868-3c15-434e-87f2-aba60e86d27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:24.869397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c69868-3c15-434e-87f2-aba60e86d27f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:24.882989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1002/2024] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:24.886950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:24.890372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b7054-b297-4e25-ac28-591fd9cd0b3f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:24.903230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b7054-b297-4e25-ac28-591fd9cd0b3f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:24.908684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0dc84-10f2-48d6-af37-c19395883860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:24.909536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0dc84-10f2-48d6-af37-c19395883860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:24.912316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0dc84-10f2-48d6-af37-c19395883860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:24.912316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0dc84-10f2-48d6-af37-c19395883860 admin admin] PATH_INFO: `/v3/projects/295104afb0eb4811b21287e3dae72c63/users/bbda6b26798a445bafc533dc09ea8bd1/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:24.937248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:24.937937 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0dc84-10f2-48d6-af37-c19395883860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=295104afb0eb4811b21287e3dae72c63, user_id=bbda6b26798a445bafc533dc09ea8bd1, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:24.941771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0dc84-10f2-48d6-af37-c19395883860 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:25.009361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c69868-3c15-434e-87f2-aba60e86d27f admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:25.014773 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-75c69868-3c15-434e-87f2-aba60e86d27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:25.026684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1023/2025] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:24 2022] PUT /identity/v3/projects/295104afb0eb4811b21287e3dae72c63/users/bbda6b26798a445bafc533dc09ea8bd1/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:25.032460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c69868-3c15-434e-87f2-aba60e86d27f admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:25.033488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0dc84-10f2-48d6-af37-c19395883860 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:25.131065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0dc84-10f2-48d6-af37-c19395883860 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:25.136676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:25.137057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7748c-2803-4533-a6dc-0a7e95c33f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:25.137554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.137734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7748c-2803-4533-a6dc-0a7e95c33f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.138036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.138213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7748c-2803-4533-a6dc-0a7e95c33f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.138396 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7748c-2803-4533-a6dc-0a7e95c33f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.138698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] PATH_INFO: `/v3/users/e6a9276d2d804791bb4582b7775bd5b9` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.139218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7748c-2803-4533-a6dc-0a7e95c33f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:25.140223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a9276d2d804791bb4582b7775bd5b9)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:25.141462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7748c-2803-4533-a6dc-0a7e95c33f2a admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:25.142665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:25.158699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1024/2026] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:25.159918 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7748c-2803-4533-a6dc-0a7e95c33f2a admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:25.172102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7748c-2803-4533-a6dc-0a7e95c33f2a admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:25.178194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:25.179322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b7da9-8d0f-4fa4-987b-59cbe05d88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:25.179950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b7da9-8d0f-4fa4-987b-59cbe05d88c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.180301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b7da9-8d0f-4fa4-987b-59cbe05d88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.183196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b7da9-8d0f-4fa4-987b-59cbe05d88c6 admin admin] PATH_INFO: `/v3/projects/295104afb0eb4811b21287e3dae72c63/users/bbda6b26798a445bafc533dc09ea8bd1/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.183617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b7da9-8d0f-4fa4-987b-59cbe05d88c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=295104afb0eb4811b21287e3dae72c63, user_id=bbda6b26798a445bafc533dc09ea8bd1, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:25.186679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b7da9-8d0f-4fa4-987b-59cbe05d88c6 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:25.208729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1025/2027] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:25 2022] PUT /identity/v3/projects/295104afb0eb4811b21287e3dae72c63/users/bbda6b26798a445bafc533dc09ea8bd1/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:25.223751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e84c6-4d00-4c17-bf89-898a41c9098a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.224237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e84c6-4d00-4c17-bf89-898a41c9098a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.224610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e84c6-4d00-4c17-bf89-898a41c9098a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.257554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3b2e84c6-4d00-4c17-bf89-898a41c9098a None None] MFA Rules not processed for user `bbda6b26798a445bafc533dc09ea8bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:25.258826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3b2e84c6-4d00-4c17-bf89-898a41c9098a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:25.336026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1026/2028] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:25.337012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e84c6-4d00-4c17-bf89-898a41c9098a None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:25.339301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3b2e84c6-4d00-4c17-bf89-898a41c9098a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:25.412900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a9276d2d804791bb4582b7775bd5b9'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:25.413741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a9276d2d804791bb4582b7775bd5b9'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:25.420772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e84c6-4d00-4c17-bf89-898a41c9098a None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:25.423756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:25.424059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a9276d2d804791bb4582b7775bd5b9'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:25.425003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a9276d2d804791bb4582b7775bd5b9'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:25.428703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:25.429606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.430124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.430538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] PATH_INFO: `/v3/projects/680c3a488d8d49979533663dc24ca2dc` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.435529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680c3a488d8d49979533663dc24ca2dc)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:25.435529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:25.508810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a9276d2d804791bb4582b7775bd5b9'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:25.511295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:25.530588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1003/2029] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:25 2022] DELETE /identity/v3/users/e6a9276d2d804791bb4582b7775bd5b9 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:25.531472 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:25.532877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:25.556347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680c3a488d8d49979533663dc24ca2dc', 'request_id': 'req-ab86383f-fa5e-4109-b512-c94811420d91'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:25.567172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680c3a488d8d49979533663dc24ca2dc', 'request_id': 'req-ab86383f-fa5e-4109-b512-c94811420d91'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:25.596236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845e2a0-561a-496a-951d-929a45e30e97 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:25.647435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867f591-6656-4f96-8ef9-1f635b643015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:25.648058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867f591-6656-4f96-8ef9-1f635b643015 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.648339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867f591-6656-4f96-8ef9-1f635b643015 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.648616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867f591-6656-4f96-8ef9-1f635b643015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.650454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0867f591-6656-4f96-8ef9-1f635b643015 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:25.672798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680c3a488d8d49979533663dc24ca2dc', 'request_id': 'req-ab86383f-fa5e-4109-b512-c94811420d91'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:25.680770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] The token cache is being invalidate because project 680c3a488d8d49979533663dc24ca2dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:25.681127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:25.681877 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ab86383f-fa5e-4109-b512-c94811420d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:25.683807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1027/2030] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:25 2022] DELETE /identity/v3/projects/680c3a488d8d49979533663dc24ca2dc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:25.684906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a3b9b-e84a-4f07-9471-223b7d73b985 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.685186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a3b9b-e84a-4f07-9471-223b7d73b985 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.685457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a3b9b-e84a-4f07-9471-223b7d73b985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.706390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0b1a3b9b-e84a-4f07-9471-223b7d73b985 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:25.707751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0b1a3b9b-e84a-4f07-9471-223b7d73b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:25.724401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867f591-6656-4f96-8ef9-1f635b643015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:25.725870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867f591-6656-4f96-8ef9-1f635b643015 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:25.736698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1004/2031] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:25.743900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe11aa-2917-4f05-9385-19fcbf9dd00d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.750646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe11aa-2917-4f05-9385-19fcbf9dd00d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.750999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe11aa-2917-4f05-9385-19fcbf9dd00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.780874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1028/2032] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:25.786179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-3dbe11aa-2917-4f05-9385-19fcbf9dd00d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:25.787980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3dbe11aa-2917-4f05-9385-19fcbf9dd00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:25.793293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a3b9b-e84a-4f07-9471-223b7d73b985 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:25.795109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0b1a3b9b-e84a-4f07-9471-223b7d73b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:25.805495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1005/2033] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:25.814654 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9669aaa-f8aa-425b-8732-3843e4b58215 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.815546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9669aaa-f8aa-425b-8732-3843e4b58215 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.816039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9669aaa-f8aa-425b-8732-3843e4b58215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.866156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d9669aaa-f8aa-425b-8732-3843e4b58215 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:25.870462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d9669aaa-f8aa-425b-8732-3843e4b58215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:25.884952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1006/2034] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:25.890038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9669aaa-f8aa-425b-8732-3843e4b58215 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:25.899660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9669aaa-f8aa-425b-8732-3843e4b58215 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:25.900087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a3b9b-e84a-4f07-9471-223b7d73b985 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:25.905783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73178425-d673-4381-9d23-006000935ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:25.906329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe1760-571f-4600-969f-e00485734d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:25.906872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178425-d673-4381-9d23-006000935ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.907209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178425-d673-4381-9d23-006000935ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.907654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe1760-571f-4600-969f-e00485734d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.913927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe1760-571f-4600-969f-e00485734d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.914171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178425-d673-4381-9d23-006000935ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.914274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe1760-571f-4600-969f-e00485734d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.914381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73178425-d673-4381-9d23-006000935ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:25.914381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73178425-d673-4381-9d23-006000935ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:25.914381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73178425-d673-4381-9d23-006000935ff5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:25.926620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe1760-571f-4600-969f-e00485734d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:25.928265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1007/2035] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:25.928718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe1760-571f-4600-969f-e00485734d87 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:25.932405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73178425-d673-4381-9d23-006000935ff5 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:25.940554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1029/2036] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:25.943710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73178425-d673-4381-9d23-006000935ff5 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:25.950638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaa903-047c-4724-b3ac-90493619f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:25.951264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaa903-047c-4724-b3ac-90493619f72f admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:25.951547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaa903-047c-4724-b3ac-90493619f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:25.951825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaa903-047c-4724-b3ac-90493619f72f admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:25.952620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaa903-047c-4724-b3ac-90493619f72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:25.954576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaa903-047c-4724-b3ac-90493619f72f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:26.075159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1008/2037] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:25 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:26.079456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe1760-571f-4600-969f-e00485734d87 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:26.089118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe1760-571f-4600-969f-e00485734d87 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:26.107222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:26.150280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0779f4-082c-4868-b4b6-c69c5393a854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:26.151317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0779f4-082c-4868-b4b6-c69c5393a854 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:26.151669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0779f4-082c-4868-b4b6-c69c5393a854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:26.151983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0779f4-082c-4868-b4b6-c69c5393a854 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:26.153278 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0779f4-082c-4868-b4b6-c69c5393a854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:26.155187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0779f4-082c-4868-b4b6-c69c5393a854 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:26.256257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1030/2038] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:26 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:26.257444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaa903-047c-4724-b3ac-90493619f72f admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:26.265167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:26.273251 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaa903-047c-4724-b3ac-90493619f72f admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:26.282766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec055d-c5c8-4429-a0a6-7e8c45591b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:26.288449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec055d-c5c8-4429-a0a6-7e8c45591b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:26.288449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec055d-c5c8-4429-a0a6-7e8c45591b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:26.288449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec055d-c5c8-4429-a0a6-7e8c45591b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:26.288449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec055d-c5c8-4429-a0a6-7e8c45591b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:26.289483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec055d-c5c8-4429-a0a6-7e8c45591b96 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:26.309177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1009/2039] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:26.310127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0779f4-082c-4868-b4b6-c69c5393a854 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:26.327124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0779f4-082c-4868-b4b6-c69c5393a854 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:26.346766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd11a9-50ee-4d5e-b168-b00f6a14ebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:26.346766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd11a9-50ee-4d5e-b168-b00f6a14ebac admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:26.346766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd11a9-50ee-4d5e-b168-b00f6a14ebac admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:26.346766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd11a9-50ee-4d5e-b168-b00f6a14ebac admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:26.347298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd11a9-50ee-4d5e-b168-b00f6a14ebac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:26.347298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd11a9-50ee-4d5e-b168-b00f6a14ebac admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:26.361095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1031/2040] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:26.362573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec055d-c5c8-4429-a0a6-7e8c45591b96 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:26.375980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec055d-c5c8-4429-a0a6-7e8c45591b96 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:26.380952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9635f3-ca74-4a99-96f4-a111bd87b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:26.381766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9635f3-ca74-4a99-96f4-a111bd87b7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:26.382141 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9635f3-ca74-4a99-96f4-a111bd87b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:26.382450 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9635f3-ca74-4a99-96f4-a111bd87b7a8 admin admin] PATH_INFO: `/v3/projects/0747b3f9132444d182e34debe080add2/users/ab100d11f740452cb50a958518266b17/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:26.399852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9635f3-ca74-4a99-96f4-a111bd87b7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0747b3f9132444d182e34debe080add2, user_id=ab100d11f740452cb50a958518266b17, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:26.402843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9635f3-ca74-4a99-96f4-a111bd87b7a8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:26.422192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd11a9-50ee-4d5e-b168-b00f6a14ebac admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:26.426704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-03bd11a9-50ee-4d5e-b168-b00f6a14ebac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:26.443513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd11a9-50ee-4d5e-b168-b00f6a14ebac admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:26.452999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:26.453803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:26.454226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:26.454822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] PATH_INFO: `/v3/projects/3f2e49b8bd774498b36adb76f17c4798` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:26.456251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2e49b8bd774498b36adb76f17c4798)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:26.458553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:26.509511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1010/2041] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:26 2022] PUT /identity/v3/projects/0747b3f9132444d182e34debe080add2/users/ab100d11f740452cb50a958518266b17/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:26.522761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e61a9-0c50-482d-a4c3-52c9c9eea7e0 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:26.523048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e61a9-0c50-482d-a4c3-52c9c9eea7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:26.523324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e61a9-0c50-482d-a4c3-52c9c9eea7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:26.556129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-a32e61a9-0c50-482d-a4c3-52c9c9eea7e0 None None] MFA Rules not processed for user `ab100d11f740452cb50a958518266b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:26.558130 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a32e61a9-0c50-482d-a4c3-52c9c9eea7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:26.602082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2e49b8bd774498b36adb76f17c4798', 'request_id': 'req-8a425b96-c8c0-486c-8dc4-7431d5eccc93'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:26.613421 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2e49b8bd774498b36adb76f17c4798', 'request_id': 'req-8a425b96-c8c0-486c-8dc4-7431d5eccc93'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:26.641427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1011/2042] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:26.646387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e61a9-0c50-482d-a4c3-52c9c9eea7e0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:26.694900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2e49b8bd774498b36adb76f17c4798', 'request_id': 'req-8a425b96-c8c0-486c-8dc4-7431d5eccc93'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:26.721352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] The token cache is being invalidate because project 3f2e49b8bd774498b36adb76f17c4798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:26.721644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:26.722354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:26.724403 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1032/2043] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:26 2022] DELETE /identity/v3/projects/3f2e49b8bd774498b36adb76f17c4798 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:26.728705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:26.744378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:26.772315 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e61a9-0c50-482d-a4c3-52c9c9eea7e0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:26.887419 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262beddc-6609-453c-8030-046ba1e96bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:26.888663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262beddc-6609-453c-8030-046ba1e96bce admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:26.889469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262beddc-6609-453c-8030-046ba1e96bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:26.890220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262beddc-6609-453c-8030-046ba1e96bce admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:26.892124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262beddc-6609-453c-8030-046ba1e96bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:26.895520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262beddc-6609-453c-8030-046ba1e96bce admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:26.899676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a425b96-c8c0-486c-8dc4-7431d5eccc93 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:26.908820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:26.909533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:26.909860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:26.910464 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] PATH_INFO: `/v3/users/37aa7165bb5749d5bffcdb116bfde57a` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:26.912097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37aa7165bb5749d5bffcdb116bfde57a)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:26.914607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:26.960360 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:26.995269 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:27.113491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1012/2044] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:26 2022] POST /identity/v3/projects => generated 381 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:27.118786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262beddc-6609-453c-8030-046ba1e96bce admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:27.120907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-262beddc-6609-453c-8030-046ba1e96bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:27.233234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262beddc-6609-453c-8030-046ba1e96bce admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:27.237995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b2ac5-191f-4b36-9c4c-d9945e938e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:27.238712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b2ac5-191f-4b36-9c4c-d9945e938e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:27.238999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b2ac5-191f-4b36-9c4c-d9945e938e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:27.239276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b2ac5-191f-4b36-9c4c-d9945e938e97 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:27.239983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b2ac5-191f-4b36-9c4c-d9945e938e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:27.241975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b2ac5-191f-4b36-9c4c-d9945e938e97 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:27.266487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37aa7165bb5749d5bffcdb116bfde57a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:27.267733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37aa7165bb5749d5bffcdb116bfde57a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:27.276283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37aa7165bb5749d5bffcdb116bfde57a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:27.293907 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37aa7165bb5749d5bffcdb116bfde57a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:27.369069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1013/2045] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:27 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:27.375144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b2ac5-191f-4b36-9c4c-d9945e938e97 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:27.380183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6d2b2ac5-191f-4b36-9c4c-d9945e938e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:27.395880 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37aa7165bb5749d5bffcdb116bfde57a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:27.406536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1033/2046] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:26 2022] DELETE /identity/v3/users/37aa7165bb5749d5bffcdb116bfde57a => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:27.447473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b2ac5-191f-4b36-9c4c-d9945e938e97 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:27.588263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff351c-67dd-436c-8564-146010031dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:27.589847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff351c-67dd-436c-8564-146010031dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:27.590188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff351c-67dd-436c-8564-146010031dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:27.590510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff351c-67dd-436c-8564-146010031dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:27.591379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff351c-67dd-436c-8564-146010031dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:27.593321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff351c-67dd-436c-8564-146010031dc6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:27.608511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1014/2047] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:27.611779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:27.634358 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53cdc-c7a2-49c5-b7dc-a8e34a9ba183 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:27.648373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce351c-5eef-46a4-bd00-4220c7948a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:27.649202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce351c-5eef-46a4-bd00-4220c7948a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:27.649885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce351c-5eef-46a4-bd00-4220c7948a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:27.650379 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce351c-5eef-46a4-bd00-4220c7948a6e admin admin] PATH_INFO: `/v3/projects/9ec989a23561433d8da6958cb18ddff8/users/34c6b37b0d4c46d4955a56e8bb4a248c/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:27.698805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce351c-5eef-46a4-bd00-4220c7948a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec989a23561433d8da6958cb18ddff8, user_id=34c6b37b0d4c46d4955a56e8bb4a248c, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:27.703698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce351c-5eef-46a4-bd00-4220c7948a6e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:27.783980 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1034/2048] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:27 2022] PUT /identity/v3/projects/9ec989a23561433d8da6958cb18ddff8/users/34c6b37b0d4c46d4955a56e8bb4a248c/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:27.792925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff351c-67dd-436c-8564-146010031dc6 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:27.803498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff351c-67dd-436c-8564-146010031dc6 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:27.879709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e4e9a-34a9-4bfa-826a-01e735570fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:27.880462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e4e9a-34a9-4bfa-826a-01e735570fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:27.880814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e4e9a-34a9-4bfa-826a-01e735570fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:27.881108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e4e9a-34a9-4bfa-826a-01e735570fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:27.881813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e4e9a-34a9-4bfa-826a-01e735570fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:27.883491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e4e9a-34a9-4bfa-826a-01e735570fe0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:27.895912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1015/2049] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:27.900914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce351c-5eef-46a4-bd00-4220c7948a6e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:27.914385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce351c-5eef-46a4-bd00-4220c7948a6e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:27.920799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853894-3ee8-4dcb-890c-48657ab203d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:27.921920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853894-3ee8-4dcb-890c-48657ab203d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:27.922045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853894-3ee8-4dcb-890c-48657ab203d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:27.922400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853894-3ee8-4dcb-890c-48657ab203d0 admin admin] PATH_INFO: `/v3/projects/9ec989a23561433d8da6958cb18ddff8/users/34c6b37b0d4c46d4955a56e8bb4a248c/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:27.924531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12853894-3ee8-4dcb-890c-48657ab203d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec989a23561433d8da6958cb18ddff8, user_id=34c6b37b0d4c46d4955a56e8bb4a248c, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:27.927370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12853894-3ee8-4dcb-890c-48657ab203d0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:27.938822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1035/2050] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:27 2022] PUT /identity/v3/projects/9ec989a23561433d8da6958cb18ddff8/users/34c6b37b0d4c46d4955a56e8bb4a248c/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:27.949739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068c428-a7c1-4732-8324-2cf6548a1fe6 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:27.950295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068c428-a7c1-4732-8324-2cf6548a1fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:27.950668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068c428-a7c1-4732-8324-2cf6548a1fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:27.973200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:27.983111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-5068c428-a7c1-4732-8324-2cf6548a1fe6 None None] MFA Rules not processed for user `34c6b37b0d4c46d4955a56e8bb4a248c`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:27.984503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5068c428-a7c1-4732-8324-2cf6548a1fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:28.064026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1016/2051] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:28.091269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853894-3ee8-4dcb-890c-48657ab203d0 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:28.093112 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-12853894-3ee8-4dcb-890c-48657ab203d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:28.205222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068c428-a7c1-4732-8324-2cf6548a1fe6 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:28.205222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5068c428-a7c1-4732-8324-2cf6548a1fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:28.264632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853894-3ee8-4dcb-890c-48657ab203d0 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:28.272507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:28.274109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:28.279134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:28.279134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] PATH_INFO: `/v3/projects/3493ad30388949298437d5caa35d08d3` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:28.279134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3493ad30388949298437d5caa35d08d3)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:28.279134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:28.333547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068c428-a7c1-4732-8324-2cf6548a1fe6 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:28.338782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee008696-5e4e-461a-8e3f-97ddf5e9a63b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:28.339429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee008696-5e4e-461a-8e3f-97ddf5e9a63b service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:28.339711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee008696-5e4e-461a-8e3f-97ddf5e9a63b service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:28.340449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee008696-5e4e-461a-8e3f-97ddf5e9a63b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:28.350320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee008696-5e4e-461a-8e3f-97ddf5e9a63b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:28.351866 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee008696-5e4e-461a-8e3f-97ddf5e9a63b service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:28.363955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1017/2052] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:28.504843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3493ad30388949298437d5caa35d08d3', 'request_id': 'req-907e8052-21b1-452d-ac75-20fdbfd558fe'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:28.515924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3493ad30388949298437d5caa35d08d3', 'request_id': 'req-907e8052-21b1-452d-ac75-20fdbfd558fe'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:28.619259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee008696-5e4e-461a-8e3f-97ddf5e9a63b service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:28.622079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ee008696-5e4e-461a-8e3f-97ddf5e9a63b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:28.633964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee008696-5e4e-461a-8e3f-97ddf5e9a63b service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:28.661905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3493ad30388949298437d5caa35d08d3', 'request_id': 'req-907e8052-21b1-452d-ac75-20fdbfd558fe'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:28.665909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:28.676308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] The token cache is being invalidate because project 3493ad30388949298437d5caa35d08d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:28.676308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:28.677085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-907e8052-21b1-452d-ac75-20fdbfd558fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:28.679133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1036/2053] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:28 2022] DELETE /identity/v3/projects/3493ad30388949298437d5caa35d08d3 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:28.683984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6010db-16a5-434e-a6c9-497549fcca0d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:28.684430 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6010db-16a5-434e-a6c9-497549fcca0d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:28.685229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6010db-16a5-434e-a6c9-497549fcca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:28.700498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a7f11-4637-46d5-90c1-2aeb8ee8afe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:28.701801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a7f11-4637-46d5-90c1-2aeb8ee8afe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:28.702256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a7f11-4637-46d5-90c1-2aeb8ee8afe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:28.703764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a7f11-4637-46d5-90c1-2aeb8ee8afe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:28.705736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2a8a7f11-4637-46d5-90c1-2aeb8ee8afe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:28.707011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-6e6010db-16a5-434e-a6c9-497549fcca0d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:28.708410 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6e6010db-16a5-434e-a6c9-497549fcca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:28.808045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a7f11-4637-46d5-90c1-2aeb8ee8afe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:28.813219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a7f11-4637-46d5-90c1-2aeb8ee8afe9 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:28.813606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1037/2054] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:28.821479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e13b-c1d5-4540-8852-9640cb2d0f32 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:28.821765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e13b-c1d5-4540-8852-9640cb2d0f32 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:28.822040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e13b-c1d5-4540-8852-9640cb2d0f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:28.823339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1018/2055] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:28.849970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-63f8e13b-c1d5-4540-8852-9640cb2d0f32 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:28.851267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-63f8e13b-c1d5-4540-8852-9640cb2d0f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:28.861670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1038/2056] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:28.866366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a7f11-4637-46d5-90c1-2aeb8ee8afe9 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:28.884911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a7f11-4637-46d5-90c1-2aeb8ee8afe9 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:28.898413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50531f8-5189-4424-8fea-be76241689f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:28.901130 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50531f8-5189-4424-8fea-be76241689f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:28.901698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50531f8-5189-4424-8fea-be76241689f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:28.902720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50531f8-5189-4424-8fea-be76241689f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:28.903645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50531f8-5189-4424-8fea-be76241689f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:28.904109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50531f8-5189-4424-8fea-be76241689f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:28.907365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50531f8-5189-4424-8fea-be76241689f7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:28.926362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1019/2057] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:26:28.934932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e13b-c1d5-4540-8852-9640cb2d0f32 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:28.945815 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e13b-c1d5-4540-8852-9640cb2d0f32 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:28.956120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025e3a9-dcd0-4d5a-b599-0ec8e1f909d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:28.956764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025e3a9-dcd0-4d5a-b599-0ec8e1f909d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:28.957048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025e3a9-dcd0-4d5a-b599-0ec8e1f909d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:28.957318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025e3a9-dcd0-4d5a-b599-0ec8e1f909d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:28.958020 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025e3a9-dcd0-4d5a-b599-0ec8e1f909d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:28.960232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025e3a9-dcd0-4d5a-b599-0ec8e1f909d0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:29.125773 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1039/2058] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:28 2022] POST /identity/v3/projects => generated 363 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:29.130707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50531f8-5189-4424-8fea-be76241689f7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:29.138381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025e3a9-dcd0-4d5a-b599-0ec8e1f909d0 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:29.140232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1025e3a9-dcd0-4d5a-b599-0ec8e1f909d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:29.151725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50531f8-5189-4424-8fea-be76241689f7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:29.237582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025e3a9-dcd0-4d5a-b599-0ec8e1f909d0 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:29.244545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:29.246035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:29.246325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:29.246615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] PATH_INFO: `/v3/users/ab100d11f740452cb50a958518266b17` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:29.247267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57be264-7364-4386-baec-378e88658dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:29.247863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab100d11f740452cb50a958518266b17)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:29.247987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be264-7364-4386-baec-378e88658dbe admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:29.248182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be264-7364-4386-baec-378e88658dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:29.248455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be264-7364-4386-baec-378e88658dbe admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:29.249143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57be264-7364-4386-baec-378e88658dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:29.249870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:29.251572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57be264-7364-4386-baec-378e88658dbe admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:29.405119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1020/2059] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:29 2022] POST /identity/v3/users => generated 282 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:29.413793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57be264-7364-4386-baec-378e88658dbe admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:29.443584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57be264-7364-4386-baec-378e88658dbe admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:29.465936 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381509c-d20c-49c1-9b4c-8302550b6bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:29.466607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381509c-d20c-49c1-9b4c-8302550b6bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:29.466972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381509c-d20c-49c1-9b4c-8302550b6bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:29.467154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381509c-d20c-49c1-9b4c-8302550b6bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:29.468129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381509c-d20c-49c1-9b4c-8302550b6bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:29.469886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381509c-d20c-49c1-9b4c-8302550b6bf4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:29.483221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1021/2060] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:29.489021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381509c-d20c-49c1-9b4c-8302550b6bf4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:29.501376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381509c-d20c-49c1-9b4c-8302550b6bf4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:29.508555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cae43-03ca-4df3-b3e3-076546e91caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:29.509190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cae43-03ca-4df3-b3e3-076546e91caf admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:29.509562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cae43-03ca-4df3-b3e3-076546e91caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:29.509735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cae43-03ca-4df3-b3e3-076546e91caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:29.511162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cae43-03ca-4df3-b3e3-076546e91caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:29.512251 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cae43-03ca-4df3-b3e3-076546e91caf admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:29.531856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1022/2061] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:29.532382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab100d11f740452cb50a958518266b17'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:29.533273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab100d11f740452cb50a958518266b17'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:29.533531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cae43-03ca-4df3-b3e3-076546e91caf admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:29.550009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9b8cae43-03ca-4df3-b3e3-076546e91caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:29.566383 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab100d11f740452cb50a958518266b17'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:29.593337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cae43-03ca-4df3-b3e3-076546e91caf admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:29.608215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683a5ed-e97d-4f4c-8f53-19b385c404dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:29.609114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683a5ed-e97d-4f4c-8f53-19b385c404dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:29.609419 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683a5ed-e97d-4f4c-8f53-19b385c404dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:29.609710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683a5ed-e97d-4f4c-8f53-19b385c404dd admin admin] PATH_INFO: `/v3/projects/25c77dd29e224d05a382cba94fc4d39d/users/0638c10b40a4431db183f8e8480f8b42/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:29.620429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab100d11f740452cb50a958518266b17'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:29.625658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:29.637654 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683a5ed-e97d-4f4c-8f53-19b385c404dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c77dd29e224d05a382cba94fc4d39d, user_id=0638c10b40a4431db183f8e8480f8b42, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:29.640454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683a5ed-e97d-4f4c-8f53-19b385c404dd admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:29.794423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-5c626804-c398-40a4-a500-e124a9092515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab100d11f740452cb50a958518266b17'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:29.802840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1040/2062] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:29 2022] DELETE /identity/v3/users/ab100d11f740452cb50a958518266b17 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:29.808792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1023/2063] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:29 2022] PUT /identity/v3/projects/25c77dd29e224d05a382cba94fc4d39d/users/0638c10b40a4431db183f8e8480f8b42/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:29.809699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d7275-a2d8-4367-ae51-719554aea088 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:29.809998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d7275-a2d8-4367-ae51-719554aea088 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:29.810287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d7275-a2d8-4367-ae51-719554aea088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:29.823890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c2fde-3d0a-4047-93eb-fa2a8a34d909 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:29.823890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c2fde-3d0a-4047-93eb-fa2a8a34d909 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:29.824407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c2fde-3d0a-4047-93eb-fa2a8a34d909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:29.845817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-189d7275-a2d8-4367-ae51-719554aea088 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:29.848814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-189d7275-a2d8-4367-ae51-719554aea088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:29.881260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-bc8c2fde-3d0a-4047-93eb-fa2a8a34d909 None None] MFA Rules not processed for user `0638c10b40a4431db183f8e8480f8b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:29.883189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-bc8c2fde-3d0a-4047-93eb-fa2a8a34d909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:29.974718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1041/2064] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:29.987046 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d7275-a2d8-4367-ae51-719554aea088 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:29.988501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-189d7275-a2d8-4367-ae51-719554aea088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:30.012146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1024/2065] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:30.017774 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c2fde-3d0a-4047-93eb-fa2a8a34d909 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:30.034816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c2fde-3d0a-4047-93eb-fa2a8a34d909 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:30.061649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fc69-c9a1-4cef-9558-96485e6aba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:30.063160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fc69-c9a1-4cef-9558-96485e6aba09 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:30.063160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fc69-c9a1-4cef-9558-96485e6aba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:30.063160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fc69-c9a1-4cef-9558-96485e6aba09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:30.063841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2fc69-c9a1-4cef-9558-96485e6aba09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:30.065823 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2fc69-c9a1-4cef-9558-96485e6aba09 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:30.085086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d7275-a2d8-4367-ae51-719554aea088 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:30.092326 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b75c8-9add-4a3f-9ab6-db27d736dba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:30.093325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b75c8-9add-4a3f-9ab6-db27d736dba3 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:30.093833 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b75c8-9add-4a3f-9ab6-db27d736dba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:30.094455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b75c8-9add-4a3f-9ab6-db27d736dba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:30.110145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b75c8-9add-4a3f-9ab6-db27d736dba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:30.114512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b75c8-9add-4a3f-9ab6-db27d736dba3 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:30.128544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1042/2066] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:30.221289 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1025/2067] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:30 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:30.226796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b75c8-9add-4a3f-9ab6-db27d736dba3 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:30.237926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b75c8-9add-4a3f-9ab6-db27d736dba3 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:30.319042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275612dd-b73a-4170-97b3-678923f21500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:30.319869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275612dd-b73a-4170-97b3-678923f21500 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:30.320135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275612dd-b73a-4170-97b3-678923f21500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:30.320549 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275612dd-b73a-4170-97b3-678923f21500 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:30.321234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275612dd-b73a-4170-97b3-678923f21500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:30.323348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275612dd-b73a-4170-97b3-678923f21500 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:30.465439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1043/2068] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:30 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:30.470406 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fc69-c9a1-4cef-9558-96485e6aba09 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:30.484310 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:30.496790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fc69-c9a1-4cef-9558-96485e6aba09 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:30.506821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9da33-a9cd-4374-8503-4d57aeb16e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:30.507978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9da33-a9cd-4374-8503-4d57aeb16e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:30.508482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9da33-a9cd-4374-8503-4d57aeb16e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:30.509000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9da33-a9cd-4374-8503-4d57aeb16e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:30.511167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9da33-a9cd-4374-8503-4d57aeb16e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:30.514539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9da33-a9cd-4374-8503-4d57aeb16e70 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:30.542074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1026/2069] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:30.554623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275612dd-b73a-4170-97b3-678923f21500 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:30.565323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275612dd-b73a-4170-97b3-678923f21500 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:30.578481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc902a19-2566-4e1f-9634-0a6741f7d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:30.579171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc902a19-2566-4e1f-9634-0a6741f7d97a admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:30.579456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc902a19-2566-4e1f-9634-0a6741f7d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:30.579731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc902a19-2566-4e1f-9634-0a6741f7d97a admin admin] PATH_INFO: `/v3/projects/d1c99641b09444769655e0ff23ec756d/users/f6378acb2def4f798c24c7246109938b/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:30.597602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc902a19-2566-4e1f-9634-0a6741f7d97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c99641b09444769655e0ff23ec756d, user_id=f6378acb2def4f798c24c7246109938b, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:30.600420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc902a19-2566-4e1f-9634-0a6741f7d97a admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:30.712342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:30.714718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1044/2070] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:30 2022] PUT /identity/v3/projects/d1c99641b09444769655e0ff23ec756d/users/f6378acb2def4f798c24c7246109938b/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:30.715373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9da33-a9cd-4374-8503-4d57aeb16e70 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:30.716277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc902a19-2566-4e1f-9634-0a6741f7d97a admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:30.718895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-38a9da33-a9cd-4374-8503-4d57aeb16e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:30.746545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9da33-a9cd-4374-8503-4d57aeb16e70 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:30.819322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc902a19-2566-4e1f-9634-0a6741f7d97a admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:30.825597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:30.826424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:30.826621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:30.826844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] PATH_INFO: `/v3/projects/0747b3f9132444d182e34debe080add2` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:30.828046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0747b3f9132444d182e34debe080add2)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:30.830359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34d924-737a-49ea-b492-89ecb4750f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:30.830614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:30.830756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34d924-737a-49ea-b492-89ecb4750f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:30.830993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34d924-737a-49ea-b492-89ecb4750f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:30.831487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34d924-737a-49ea-b492-89ecb4750f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:30.833068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34d924-737a-49ea-b492-89ecb4750f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:30.836300 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34d924-737a-49ea-b492-89ecb4750f1b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:30.853714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1045/2071] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:30.859007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34d924-737a-49ea-b492-89ecb4750f1b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:30.874356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34d924-737a-49ea-b492-89ecb4750f1b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:30.879595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9c86f-b6ff-4851-b151-d16fdc74a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:30.880297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9c86f-b6ff-4851-b151-d16fdc74a442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:30.880590 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9c86f-b6ff-4851-b151-d16fdc74a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:30.881088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9c86f-b6ff-4851-b151-d16fdc74a442 admin admin] PATH_INFO: `/v3/projects/d1c99641b09444769655e0ff23ec756d/users/f6378acb2def4f798c24c7246109938b/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:30.894622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9c86f-b6ff-4851-b151-d16fdc74a442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c99641b09444769655e0ff23ec756d, user_id=f6378acb2def4f798c24c7246109938b, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:30.894622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9c86f-b6ff-4851-b151-d16fdc74a442 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:30.900192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1046/2072] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:30 2022] PUT /identity/v3/projects/d1c99641b09444769655e0ff23ec756d/users/f6378acb2def4f798c24c7246109938b/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:30.926011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465dbb1-1c06-4241-8866-58eae536ed83 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:30.933538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465dbb1-1c06-4241-8866-58eae536ed83 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:30.933538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465dbb1-1c06-4241-8866-58eae536ed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:30.975158 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b465dbb1-1c06-4241-8866-58eae536ed83 None None] MFA Rules not processed for user `f6378acb2def4f798c24c7246109938b`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:30.976679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b465dbb1-1c06-4241-8866-58eae536ed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:31.014633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0747b3f9132444d182e34debe080add2', 'request_id': 'req-3300b5de-a56e-42d1-9716-a3faa77f4c78'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:31.028697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0747b3f9132444d182e34debe080add2', 'request_id': 'req-3300b5de-a56e-42d1-9716-a3faa77f4c78'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:31.078788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1047/2073] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:31.078788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465dbb1-1c06-4241-8866-58eae536ed83 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:31.081321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b465dbb1-1c06-4241-8866-58eae536ed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:31.143993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465dbb1-1c06-4241-8866-58eae536ed83 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:31.171099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0747b3f9132444d182e34debe080add2', 'request_id': 'req-3300b5de-a56e-42d1-9716-a3faa77f4c78'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:31.186622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] The token cache is being invalidate because project 0747b3f9132444d182e34debe080add2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:31.186904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:31.187847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:31.189416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1027/2074] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:30 2022] DELETE /identity/v3/projects/0747b3f9132444d182e34debe080add2 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:31.195847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:31.195847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:31.206032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68721fcc-cdb9-4c49-91a5-c0639f0b3cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:31.206690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68721fcc-cdb9-4c49-91a5-c0639f0b3cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:31.206964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68721fcc-cdb9-4c49-91a5-c0639f0b3cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:31.207227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68721fcc-cdb9-4c49-91a5-c0639f0b3cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:31.209179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-68721fcc-cdb9-4c49-91a5-c0639f0b3cd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:31.279574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300b5de-a56e-42d1-9716-a3faa77f4c78 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:31.284605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:31.285514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:31.285796 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:31.286061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] PATH_INFO: `/v3/users/34c6b37b0d4c46d4955a56e8bb4a248c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:31.286702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68721fcc-cdb9-4c49-91a5-c0639f0b3cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:31.287271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c6b37b0d4c46d4955a56e8bb4a248c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:31.288245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68721fcc-cdb9-4c49-91a5-c0639f0b3cd8 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:31.289196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:31.299782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1048/2075] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:31.567986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:31.578042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68721fcc-cdb9-4c49-91a5-c0639f0b3cd8 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:31.579565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-68721fcc-cdb9-4c49-91a5-c0639f0b3cd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:31.587129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c6b37b0d4c46d4955a56e8bb4a248c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:31.587878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c6b37b0d4c46d4955a56e8bb4a248c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:31.591718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68721fcc-cdb9-4c49-91a5-c0639f0b3cd8 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:31.596898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c6b37b0d4c46d4955a56e8bb4a248c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:31.597943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c6b37b0d4c46d4955a56e8bb4a248c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:31.601263 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89dda2-5339-4f41-b66a-3bc0177766d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:31.602161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89dda2-5339-4f41-b66a-3bc0177766d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:31.602499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89dda2-5339-4f41-b66a-3bc0177766d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:31.602954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89dda2-5339-4f41-b66a-3bc0177766d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:31.606824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6b89dda2-5339-4f41-b66a-3bc0177766d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:31.697840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89dda2-5339-4f41-b66a-3bc0177766d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:31.699303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89dda2-5339-4f41-b66a-3bc0177766d8 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:31.709464 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1049/2076] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:31.742614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c6b37b0d4c46d4955a56e8bb4a248c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:31.761774 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1028/2077] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:31 2022] DELETE /identity/v3/users/34c6b37b0d4c46d4955a56e8bb4a248c => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:32.174203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89dda2-5339-4f41-b66a-3bc0177766d8 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:32.174203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6b89dda2-5339-4f41-b66a-3bc0177766d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:32.182558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89dda2-5339-4f41-b66a-3bc0177766d8 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:32.256006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:32.313527 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e759-bcec-47a9-9ae2-6dd89a800834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:32.314537 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e759-bcec-47a9-9ae2-6dd89a800834 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:32.315063 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e759-bcec-47a9-9ae2-6dd89a800834 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:32.315666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e759-bcec-47a9-9ae2-6dd89a800834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:32.319722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ecb8e759-bcec-47a9-9ae2-6dd89a800834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:32.407954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e759-bcec-47a9-9ae2-6dd89a800834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:32.409479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e759-bcec-47a9-9ae2-6dd89a800834 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:32.420270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1050/2078] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:32.467713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:32.469161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:32.554962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfc5a1-4f67-43da-8e80-faf04238a233 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:32.560354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:32.561047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:32.561333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:32.561610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] PATH_INFO: `/v3/projects/9ec989a23561433d8da6958cb18ddff8` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:32.562842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec989a23561433d8da6958cb18ddff8)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:32.565617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:32.753796 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec989a23561433d8da6958cb18ddff8', 'request_id': 'req-29f4943c-9bf1-40bd-a6db-14291fbe419e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:32.760502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec989a23561433d8da6958cb18ddff8', 'request_id': 'req-29f4943c-9bf1-40bd-a6db-14291fbe419e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:32.869013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec989a23561433d8da6958cb18ddff8', 'request_id': 'req-29f4943c-9bf1-40bd-a6db-14291fbe419e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:32.882014 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] The token cache is being invalidate because project 9ec989a23561433d8da6958cb18ddff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:32.882302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:32.883005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-29f4943c-9bf1-40bd-a6db-14291fbe419e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:32.884617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1029/2079] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:32 2022] DELETE /identity/v3/projects/9ec989a23561433d8da6958cb18ddff8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:32.891324 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581188-8578-494d-952a-dcecd597d794 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:32.891812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581188-8578-494d-952a-dcecd597d794 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:32.891904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581188-8578-494d-952a-dcecd597d794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:32.914684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-93581188-8578-494d-952a-dcecd597d794 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:32.916344 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-93581188-8578-494d-952a-dcecd597d794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:32.991114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1051/2080] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:33.016922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac197b-8101-4434-a1f4-e6f11e5bedbc None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:33.070655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac197b-8101-4434-a1f4-e6f11e5bedbc None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:33.070655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac197b-8101-4434-a1f4-e6f11e5bedbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:33.070655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-5cac197b-8101-4434-a1f4-e6f11e5bedbc None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:33.070655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5cac197b-8101-4434-a1f4-e6f11e5bedbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:33.079530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1030/2081] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:33.084529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581188-8578-494d-952a-dcecd597d794 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:33.103530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581188-8578-494d-952a-dcecd597d794 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:33.109927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d7f44-5164-4ec8-936b-9033f03061dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:33.110759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d7f44-5164-4ec8-936b-9033f03061dc admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:33.111126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d7f44-5164-4ec8-936b-9033f03061dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:33.111550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d7f44-5164-4ec8-936b-9033f03061dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:33.112667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d7f44-5164-4ec8-936b-9033f03061dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:33.113188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d7f44-5164-4ec8-936b-9033f03061dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:33.115367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d7f44-5164-4ec8-936b-9033f03061dc admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:33.129143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1052/2082] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:33.133671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac197b-8101-4434-a1f4-e6f11e5bedbc None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:33.143532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac197b-8101-4434-a1f4-e6f11e5bedbc None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:33.148655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7b2dd-86e8-4f5a-8de5-9166571feb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:33.149254 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b2dd-86e8-4f5a-8de5-9166571feb92 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:33.149526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b2dd-86e8-4f5a-8de5-9166571feb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:33.149794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b2dd-86e8-4f5a-8de5-9166571feb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:33.150491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7b2dd-86e8-4f5a-8de5-9166571feb92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:33.153223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7b2dd-86e8-4f5a-8de5-9166571feb92 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:33.169839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:33.321952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1031/2083] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:33 2022] POST /identity/v3/projects => generated 359 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:33.325220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d7f44-5164-4ec8-936b-9033f03061dc admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:33.339520 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d7f44-5164-4ec8-936b-9033f03061dc admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:33.410572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd62a5-1db9-47ff-ba1a-bf25fafb5b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:33.411222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd62a5-1db9-47ff-ba1a-bf25fafb5b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:33.411511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd62a5-1db9-47ff-ba1a-bf25fafb5b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:33.411767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd62a5-1db9-47ff-ba1a-bf25fafb5b66 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:33.412425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd62a5-1db9-47ff-ba1a-bf25fafb5b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:33.414570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd62a5-1db9-47ff-ba1a-bf25fafb5b66 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:33.547657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1053/2084] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:33 2022] POST /identity/v3/users => generated 280 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:33.551688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7b2dd-86e8-4f5a-8de5-9166571feb92 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:33.565324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7b2dd-86e8-4f5a-8de5-9166571feb92 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:33.571923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18089054-8e6c-4f72-99d8-b8f8dc9c20fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:33.572594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18089054-8e6c-4f72-99d8-b8f8dc9c20fa admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:33.573053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18089054-8e6c-4f72-99d8-b8f8dc9c20fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:33.574619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18089054-8e6c-4f72-99d8-b8f8dc9c20fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:33.575508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18089054-8e6c-4f72-99d8-b8f8dc9c20fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:33.578038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18089054-8e6c-4f72-99d8-b8f8dc9c20fa admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:33.593531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1032/2085] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:33.594720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd62a5-1db9-47ff-ba1a-bf25fafb5b66 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:33.621967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd62a5-1db9-47ff-ba1a-bf25fafb5b66 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:33.628527 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50684a-2e82-48b1-8926-527cc637dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:33.629436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50684a-2e82-48b1-8926-527cc637dcab admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:33.629741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50684a-2e82-48b1-8926-527cc637dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:33.630167 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50684a-2e82-48b1-8926-527cc637dcab admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:33.631143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50684a-2e82-48b1-8926-527cc637dcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:33.633257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50684a-2e82-48b1-8926-527cc637dcab admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:33.648523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1054/2086] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:33.653834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18089054-8e6c-4f72-99d8-b8f8dc9c20fa admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:33.669335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18089054-8e6c-4f72-99d8-b8f8dc9c20fa admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:33.693069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defa98c-bb4a-4479-81c1-1e79ea777714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:33.693069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defa98c-bb4a-4479-81c1-1e79ea777714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:33.693069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defa98c-bb4a-4479-81c1-1e79ea777714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:33.693069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defa98c-bb4a-4479-81c1-1e79ea777714 admin admin] PATH_INFO: `/v3/projects/0ceb3bba15c8444587b46a4f962d2b59/users/c4f4a69384944bf8926c723fec1471ee/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:33.734133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defa98c-bb4a-4479-81c1-1e79ea777714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ceb3bba15c8444587b46a4f962d2b59, user_id=c4f4a69384944bf8926c723fec1471ee, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:33.738546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defa98c-bb4a-4479-81c1-1e79ea777714 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:33.800727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:33.839312 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1033/2087] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:33 2022] PUT /identity/v3/projects/0ceb3bba15c8444587b46a4f962d2b59/users/c4f4a69384944bf8926c723fec1471ee/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:33.858654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8ac4b-df4b-4f8a-9656-b1e2ed870276 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:33.859259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8ac4b-df4b-4f8a-9656-b1e2ed870276 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:33.859929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8ac4b-df4b-4f8a-9656-b1e2ed870276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:33.876293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defa98c-bb4a-4479-81c1-1e79ea777714 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:33.879084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0defa98c-bb4a-4479-81c1-1e79ea777714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:33.926207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-28e8ac4b-df4b-4f8a-9656-b1e2ed870276 None None] MFA Rules not processed for user `c4f4a69384944bf8926c723fec1471ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:33.931147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-28e8ac4b-df4b-4f8a-9656-b1e2ed870276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:33.993570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defa98c-bb4a-4479-81c1-1e79ea777714 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:34.001453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:34.002122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:34.002432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:34.002707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] PATH_INFO: `/v3/users/39b46a0807f04d578f46b059bab13641` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:34.004103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b46a0807f04d578f46b059bab13641)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:34.008681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:34.061214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1055/2088] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:34.115132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8ac4b-df4b-4f8a-9656-b1e2ed870276 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:34.116648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-28e8ac4b-df4b-4f8a-9656-b1e2ed870276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:34.195285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8ac4b-df4b-4f8a-9656-b1e2ed870276 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:34.199938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c640d-04dc-4032-b797-077bd887b0e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:34.200558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c640d-04dc-4032-b797-077bd887b0e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:34.200886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c640d-04dc-4032-b797-077bd887b0e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:34.201157 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c640d-04dc-4032-b797-077bd887b0e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:34.217903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c640d-04dc-4032-b797-077bd887b0e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:34.219590 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c640d-04dc-4032-b797-077bd887b0e6 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:34.237381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1056/2089] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:34.258228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c640d-04dc-4032-b797-077bd887b0e6 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:34.278525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c640d-04dc-4032-b797-077bd887b0e6 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:34.284619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:34.291227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:34.291227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:34.291227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] PATH_INFO: `/v3/users/c4f4a69384944bf8926c723fec1471ee` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:34.291227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f4a69384944bf8926c723fec1471ee)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:34.291227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:34.330409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b46a0807f04d578f46b059bab13641'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:34.331969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b46a0807f04d578f46b059bab13641'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:34.348223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b46a0807f04d578f46b059bab13641'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:34.350088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b46a0807f04d578f46b059bab13641'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:34.436281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-7aba8da3-edd8-4830-9a0d-06a2b0259a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b46a0807f04d578f46b059bab13641'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:34.472355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1034/2090] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:33 2022] DELETE /identity/v3/users/39b46a0807f04d578f46b059bab13641 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:34.476282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323642f1-8ad2-46a3-8d85-d48b229927c9 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:34.476840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323642f1-8ad2-46a3-8d85-d48b229927c9 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:34.477272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323642f1-8ad2-46a3-8d85-d48b229927c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:34.503757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-323642f1-8ad2-46a3-8d85-d48b229927c9 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:34.505350 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-323642f1-8ad2-46a3-8d85-d48b229927c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:34.575317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f4a69384944bf8926c723fec1471ee'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:34.576021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f4a69384944bf8926c723fec1471ee'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:34.584411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:34.586756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f4a69384944bf8926c723fec1471ee'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:34.587287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:34.611619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f4a69384944bf8926c723fec1471ee'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:34.664759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1035/2091] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:34.676455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323642f1-8ad2-46a3-8d85-d48b229927c9 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:34.679109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-323642f1-8ad2-46a3-8d85-d48b229927c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:34.754912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8a90e18f-9bf3-425e-8b0e-d5014e829aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f4a69384944bf8926c723fec1471ee'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:34.765287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1057/2092] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:34 2022] DELETE /identity/v3/users/c4f4a69384944bf8926c723fec1471ee => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:34.771799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d23f2a-ac6a-436e-8192-261a3b3fd48e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:34.772416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d23f2a-ac6a-436e-8192-261a3b3fd48e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:34.772868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d23f2a-ac6a-436e-8192-261a3b3fd48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:34.789980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323642f1-8ad2-46a3-8d85-d48b229927c9 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:34.830075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-34d23f2a-ac6a-436e-8192-261a3b3fd48e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:34.833232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-34d23f2a-ac6a-436e-8192-261a3b3fd48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:34.858949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2bf1a-4455-45bc-9f2a-3d353f8d80bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:34.860026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2bf1a-4455-45bc-9f2a-3d353f8d80bd service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:34.860423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2bf1a-4455-45bc-9f2a-3d353f8d80bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:34.860841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2bf1a-4455-45bc-9f2a-3d353f8d80bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:34.927097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1058/2093] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:34.940336 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d23f2a-ac6a-436e-8192-261a3b3fd48e None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:34.959711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d23f2a-ac6a-436e-8192-261a3b3fd48e None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:34.967073 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d9b94-5a13-442e-b93a-77cb2002c1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:34.968907 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d9b94-5a13-442e-b93a-77cb2002c1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:34.969507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d9b94-5a13-442e-b93a-77cb2002c1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:34.970089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d9b94-5a13-442e-b93a-77cb2002c1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:34.987626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:35.000852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d9b94-5a13-442e-b93a-77cb2002c1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:35.003592 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d9b94-5a13-442e-b93a-77cb2002c1c1 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:35.015172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2bf1a-4455-45bc-9f2a-3d353f8d80bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:35.017239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2bf1a-4455-45bc-9f2a-3d353f8d80bd service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:35.032632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1059/2094] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:35.039361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1036/2095] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:35.971361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d9b94-5a13-442e-b93a-77cb2002c1c1 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:35.973084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f95d9b94-5a13-442e-b93a-77cb2002c1c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:35.990181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d9b94-5a13-442e-b93a-77cb2002c1c1 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:35.997208 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:35.998452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:35.998572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:35.998888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] PATH_INFO: `/v3/projects/0ceb3bba15c8444587b46a4f962d2b59` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:36.000829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ceb3bba15c8444587b46a4f962d2b59)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:36.003102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:36.059910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2bf1a-4455-45bc-9f2a-3d353f8d80bd service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:36.062124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-acc2bf1a-4455-45bc-9f2a-3d353f8d80bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:36.092543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2bf1a-4455-45bc-9f2a-3d353f8d80bd service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:36.098861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:36.099860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:36.100401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:36.100942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] PATH_INFO: `/v3/projects/d10d25a3c8ca4dc3ba31c07808a5aa57` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:36.103069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10d25a3c8ca4dc3ba31c07808a5aa57)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:36.106497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:36.180650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ceb3bba15c8444587b46a4f962d2b59', 'request_id': 'req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.192429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ceb3bba15c8444587b46a4f962d2b59', 'request_id': 'req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.279405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ceb3bba15c8444587b46a4f962d2b59', 'request_id': 'req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.302250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] The token cache is being invalidate because project 0ceb3bba15c8444587b46a4f962d2b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:36.304710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.306794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2d1730f9-5cf8-4abf-bdd1-8a62cbea501c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.311284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1060/2096] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:35 2022] DELETE /identity/v3/projects/0ceb3bba15c8444587b46a4f962d2b59 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:36.315730 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10d25a3c8ca4dc3ba31c07808a5aa57', 'request_id': 'req-341e80dd-d9e0-47f4-92fc-21ccece8f22e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.319280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb37427-e3e6-40b8-b1fa-e27483f13d05 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:36.319629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb37427-e3e6-40b8-b1fa-e27483f13d05 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:36.319996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb37427-e3e6-40b8-b1fa-e27483f13d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:36.327399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10d25a3c8ca4dc3ba31c07808a5aa57', 'request_id': 'req-341e80dd-d9e0-47f4-92fc-21ccece8f22e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.345893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-2eb37427-e3e6-40b8-b1fa-e27483f13d05 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:36.347916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2eb37427-e3e6-40b8-b1fa-e27483f13d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:36.349677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:36.420841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1061/2097] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:36.429144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ee21f-d00f-494f-9aba-7c5fbb2735aa None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:36.429433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ee21f-d00f-494f-9aba-7c5fbb2735aa None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:36.437926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ee21f-d00f-494f-9aba-7c5fbb2735aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:36.452682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a28ee21f-d00f-494f-9aba-7c5fbb2735aa None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:36.453935 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a28ee21f-d00f-494f-9aba-7c5fbb2735aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:36.461526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10d25a3c8ca4dc3ba31c07808a5aa57', 'request_id': 'req-341e80dd-d9e0-47f4-92fc-21ccece8f22e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.469442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1062/2098] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:36.473433 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ee21f-d00f-494f-9aba-7c5fbb2735aa None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:36.474974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] The token cache is being invalidate because project d10d25a3c8ca4dc3ba31c07808a5aa57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:36.475505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.476440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.479846 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1037/2099] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:36 2022] DELETE /identity/v3/projects/d10d25a3c8ca4dc3ba31c07808a5aa57 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:36.484069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:36.485826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:36.492558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ee21f-d00f-494f-9aba-7c5fbb2735aa None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:36.503127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e80dd-d9e0-47f4-92fc-21ccece8f22e admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:36.516914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:36.517721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:36.518084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:36.518473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] PATH_INFO: `/v3/users/04fabe4ed6e149c9b4f6f28750c7d124` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:36.519030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba8eae-f729-4c84-ba2a-bd8b4b0e0b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:36.519666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba8eae-f729-4c84-ba2a-bd8b4b0e0b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:36.519947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba8eae-f729-4c84-ba2a-bd8b4b0e0b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:36.520223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba8eae-f729-4c84-ba2a-bd8b4b0e0b8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:36.520772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fabe4ed6e149c9b4f6f28750c7d124)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:36.520953 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba8eae-f729-4c84-ba2a-bd8b4b0e0b8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:36.521222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba8eae-f729-4c84-ba2a-bd8b4b0e0b8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:36.523828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:36.532465 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba8eae-f729-4c84-ba2a-bd8b4b0e0b8e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:36.551535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:36.565199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1063/2100] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:26:36.570130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba8eae-f729-4c84-ba2a-bd8b4b0e0b8e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:36.574167 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-aeba8eae-f729-4c84-ba2a-bd8b4b0e0b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:36.593244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba8eae-f729-4c84-ba2a-bd8b4b0e0b8e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:36.600735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7b239-194c-4236-be93-2913a1494e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:36.602690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7b239-194c-4236-be93-2913a1494e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:36.602690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7b239-194c-4236-be93-2913a1494e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:36.602690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7b239-194c-4236-be93-2913a1494e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:36.604455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7b239-194c-4236-be93-2913a1494e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:36.607123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7b239-194c-4236-be93-2913a1494e52 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:36.756534 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1064/2101] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:36 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:36.761661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7b239-194c-4236-be93-2913a1494e52 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:36.794081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fabe4ed6e149c9b4f6f28750c7d124'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.795644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fabe4ed6e149c9b4f6f28750c7d124'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.808311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fabe4ed6e149c9b4f6f28750c7d124'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.809456 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fabe4ed6e149c9b4f6f28750c7d124'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.878974 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7b239-194c-4236-be93-2913a1494e52 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:36.884380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599373e3-8a09-44fb-ad00-98b088c81d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:36.885274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599373e3-8a09-44fb-ad00-98b088c81d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:36.885612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599373e3-8a09-44fb-ad00-98b088c81d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:36.885871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599373e3-8a09-44fb-ad00-98b088c81d3f admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:36.886733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599373e3-8a09-44fb-ad00-98b088c81d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:36.889023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599373e3-8a09-44fb-ad00-98b088c81d3f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:36.914487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fabe4ed6e149c9b4f6f28750c7d124'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:36.935394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1038/2102] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:36 2022] DELETE /identity/v3/users/04fabe4ed6e149c9b4f6f28750c7d124 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:37.030561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1065/2103] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:36 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:37.036036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:37.037121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:37.149898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f469d4-a520-46d5-95f1-53a0b880096d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:37.155507 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201a317-63e5-4d1f-b4d6-baaa6783fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:37.156147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201a317-63e5-4d1f-b4d6-baaa6783fcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:37.156431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201a317-63e5-4d1f-b4d6-baaa6783fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:37.156710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201a317-63e5-4d1f-b4d6-baaa6783fcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:37.157429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201a317-63e5-4d1f-b4d6-baaa6783fcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:37.160431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201a317-63e5-4d1f-b4d6-baaa6783fcbd admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:37.162495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599373e3-8a09-44fb-ad00-98b088c81d3f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:37.165677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-599373e3-8a09-44fb-ad00-98b088c81d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:37.173563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1039/2104] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:37.178717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201a317-63e5-4d1f-b4d6-baaa6783fcbd admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:37.193385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201a317-63e5-4d1f-b4d6-baaa6783fcbd admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:37.196940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599373e3-8a09-44fb-ad00-98b088c81d3f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:37.199596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528d437-cbd6-4382-a054-66d76d30e024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:37.200577 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528d437-cbd6-4382-a054-66d76d30e024 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:37.200856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528d437-cbd6-4382-a054-66d76d30e024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:37.201150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528d437-cbd6-4382-a054-66d76d30e024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:37.202346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528d437-cbd6-4382-a054-66d76d30e024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:37.204481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528d437-cbd6-4382-a054-66d76d30e024 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:37.207965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:37.209128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:37.209731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:37.210261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] PATH_INFO: `/v3/users/0638c10b40a4431db183f8e8480f8b42` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:37.212207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0638c10b40a4431db183f8e8480f8b42)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:37.227426 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:37.228093 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1040/2105] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:37.228548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528d437-cbd6-4382-a054-66d76d30e024 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:37.249749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528d437-cbd6-4382-a054-66d76d30e024 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:37.262824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816c920-218a-4920-b632-ab5e16d63d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:37.263601 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816c920-218a-4920-b632-ab5e16d63d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:37.264502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816c920-218a-4920-b632-ab5e16d63d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:37.265031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816c920-218a-4920-b632-ab5e16d63d38 admin admin] PATH_INFO: `/v3/projects/0351fbcc2cd643a2ba7b504a34260209/users/53e4c3f223ec4e2fb9a4a474caa0b79d/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:37.287450 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816c920-218a-4920-b632-ab5e16d63d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0351fbcc2cd643a2ba7b504a34260209, user_id=53e4c3f223ec4e2fb9a4a474caa0b79d, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:37.290210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816c920-218a-4920-b632-ab5e16d63d38 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:37.409644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1041/2106] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:37 2022] PUT /identity/v3/projects/0351fbcc2cd643a2ba7b504a34260209/users/53e4c3f223ec4e2fb9a4a474caa0b79d/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:37.411723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816c920-218a-4920-b632-ab5e16d63d38 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:37.413624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d816c920-218a-4920-b632-ab5e16d63d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:37.488809 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0638c10b40a4431db183f8e8480f8b42'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.490073 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0638c10b40a4431db183f8e8480f8b42'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.504580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0638c10b40a4431db183f8e8480f8b42'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.524974 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0638c10b40a4431db183f8e8480f8b42'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.544855 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816c920-218a-4920-b632-ab5e16d63d38 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:37.551127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:37.551890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:37.552413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:37.552602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] PATH_INFO: `/v3/users/f8ca21ca12014994ac45c18821b125f5` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:37.553935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ca21ca12014994ac45c18821b125f5)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:37.555949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:37.661133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-befa585f-5ab4-4b11-8e3c-b03d89ae752c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0638c10b40a4431db183f8e8480f8b42'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.669260 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1066/2107] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:37 2022] DELETE /identity/v3/users/0638c10b40a4431db183f8e8480f8b42 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:37.670829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad29310-bc37-46f6-a088-06ad94e0bbdb None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:37.671180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad29310-bc37-46f6-a088-06ad94e0bbdb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:37.671523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad29310-bc37-46f6-a088-06ad94e0bbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:37.707288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-8ad29310-bc37-46f6-a088-06ad94e0bbdb None None] MFA Rules not processed for user `53e4c3f223ec4e2fb9a4a474caa0b79d`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:37.707288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8ad29310-bc37-46f6-a088-06ad94e0bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:37.777568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1067/2108] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:37.778969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28266b97-0dbf-483a-af8f-7f4913bc938b None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:37.779255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28266b97-0dbf-483a-af8f-7f4913bc938b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:37.779526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28266b97-0dbf-483a-af8f-7f4913bc938b None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:37.784792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1068/2109] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:26:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:26:37.785890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28266b97-0dbf-483a-af8f-7f4913bc938b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:37.789007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-28266b97-0dbf-483a-af8f-7f4913bc938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:37.819666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ca21ca12014994ac45c18821b125f5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.820320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ca21ca12014994ac45c18821b125f5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.827476 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ca21ca12014994ac45c18821b125f5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.828386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ca21ca12014994ac45c18821b125f5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.857661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28266b97-0dbf-483a-af8f-7f4913bc938b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:37.862381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:37.863023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:37.863295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:37.863562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] PATH_INFO: `/v3/projects/0492ebf378574162af54a809508b436b` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:37.864728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0492ebf378574162af54a809508b436b)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:37.866868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:37.930240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-1c2174ff-e24e-4004-bc56-dc452933be05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ca21ca12014994ac45c18821b125f5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.949581 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1042/2110] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:37 2022] DELETE /identity/v3/users/f8ca21ca12014994ac45c18821b125f5 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:37.951006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04042cf-e5b5-4b6a-a688-c389ae61ab68 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:37.951299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04042cf-e5b5-4b6a-a688-c389ae61ab68 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:37.951619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04042cf-e5b5-4b6a-a688-c389ae61ab68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:37.972699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d04042cf-e5b5-4b6a-a688-c389ae61ab68 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:37.973030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0492ebf378574162af54a809508b436b', 'request_id': 'req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.973956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d04042cf-e5b5-4b6a-a688-c389ae61ab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:37.979641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0492ebf378574162af54a809508b436b', 'request_id': 'req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:37.984534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:38.039547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1043/2111] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:38.040323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04042cf-e5b5-4b6a-a688-c389ae61ab68 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:38.042385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d04042cf-e5b5-4b6a-a688-c389ae61ab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.055118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04042cf-e5b5-4b6a-a688-c389ae61ab68 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:38.061704 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:38.062379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.062661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.062939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] PATH_INFO: `/v3/users/e916e4e0fb7140b0912e9233898a0016` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.064182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e916e4e0fb7140b0912e9233898a0016)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:38.066171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:38.075147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0492ebf378574162af54a809508b436b', 'request_id': 'req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:38.089409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] The token cache is being invalidate because project 0492ebf378574162af54a809508b436b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:38.090163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:38.091466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cd1dcdaa-4992-4145-a0f4-39f7db49ac28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:38.097143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1069/2112] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:37 2022] DELETE /identity/v3/projects/0492ebf378574162af54a809508b436b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:38.099006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069856-7bdf-4743-95db-d6670d707754 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.099478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069856-7bdf-4743-95db-d6670d707754 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.100461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069856-7bdf-4743-95db-d6670d707754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.121236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3a069856-7bdf-4743-95db-d6670d707754 None None] MFA Rules not processed for user `448d43be14a74865a1e0d09e76c7e248`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:38.122477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3a069856-7bdf-4743-95db-d6670d707754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.188101 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1070/2113] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:26:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:38.189185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a069856-7bdf-4743-95db-d6670d707754 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:38.190584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3a069856-7bdf-4743-95db-d6670d707754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.251865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a069856-7bdf-4743-95db-d6670d707754 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:38.255513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93b67f-15dd-46c5-b3da-4f6eab2fbf12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:38.256124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93b67f-15dd-46c5-b3da-4f6eab2fbf12 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.256399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93b67f-15dd-46c5-b3da-4f6eab2fbf12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.256669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93b67f-15dd-46c5-b3da-4f6eab2fbf12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.258494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7b93b67f-15dd-46c5-b3da-4f6eab2fbf12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.317552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93b67f-15dd-46c5-b3da-4f6eab2fbf12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:38.318965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93b67f-15dd-46c5-b3da-4f6eab2fbf12 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:38.327908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1071/2114] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:38.329115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043fe0a-cd82-43b7-a2a3-441dbb49af93 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.329594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043fe0a-cd82-43b7-a2a3-441dbb49af93 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.330000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043fe0a-cd82-43b7-a2a3-441dbb49af93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.350690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-d043fe0a-cd82-43b7-a2a3-441dbb49af93 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:38.351959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d043fe0a-cd82-43b7-a2a3-441dbb49af93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.354485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e916e4e0fb7140b0912e9233898a0016'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:38.355735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e916e4e0fb7140b0912e9233898a0016'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:38.362588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1072/2115] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:38.365373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043fe0a-cd82-43b7-a2a3-441dbb49af93 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:38.365373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d043fe0a-cd82-43b7-a2a3-441dbb49af93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.366985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e916e4e0fb7140b0912e9233898a0016'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:38.367793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e916e4e0fb7140b0912e9233898a0016'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:38.435525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043fe0a-cd82-43b7-a2a3-441dbb49af93 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:38.439557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db413b19-abb8-4066-9891-778156ae20b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:38.440182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db413b19-abb8-4066-9891-778156ae20b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.440484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db413b19-abb8-4066-9891-778156ae20b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.440729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db413b19-abb8-4066-9891-778156ae20b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.442827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-db413b19-abb8-4066-9891-778156ae20b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.451649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e916e4e0fb7140b0912e9233898a0016'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:38.455416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db413b19-abb8-4066-9891-778156ae20b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:38.456932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db413b19-abb8-4066-9891-778156ae20b3 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:38.469484 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1073/2116] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:38.470840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9b6e6-3779-405a-8a1d-2e90ec25a6a9 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.471187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9b6e6-3779-405a-8a1d-2e90ec25a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.471470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9b6e6-3779-405a-8a1d-2e90ec25a6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.484121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1044/2117] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:38 2022] DELETE /identity/v3/users/e916e4e0fb7140b0912e9233898a0016 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:38.485294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:38.486897 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.493958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-00c9b6e6-3779-405a-8a1d-2e90ec25a6a9 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:38.495369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-00c9b6e6-3779-405a-8a1d-2e90ec25a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.563738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53d023-4ee0-4f5a-b22e-c4fb612d9b14 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:38.569844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d8783-3458-4bb2-998e-8a699e608466 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:38.570726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d8783-3458-4bb2-998e-8a699e608466 service placement] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.571153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d8783-3458-4bb2-998e-8a699e608466 service placement] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.572180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d8783-3458-4bb2-998e-8a699e608466 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.574682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e37d8783-3458-4bb2-998e-8a699e608466 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.593639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1074/2118] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:38.593639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9b6e6-3779-405a-8a1d-2e90ec25a6a9 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:38.593639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-00c9b6e6-3779-405a-8a1d-2e90ec25a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.594198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d8783-3458-4bb2-998e-8a699e608466 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:38.594198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d8783-3458-4bb2-998e-8a699e608466 service placement] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:38.599935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1045/2119] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:38.604688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fada8f-0b52-4c41-9b04-09e1fb612bc9 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.609864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fada8f-0b52-4c41-9b04-09e1fb612bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.609864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fada8f-0b52-4c41-9b04-09e1fb612bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.627102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-48fada8f-0b52-4c41-9b04-09e1fb612bc9 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:38.628552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-48fada8f-0b52-4c41-9b04-09e1fb612bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.649326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1046/2120] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:38.649326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fada8f-0b52-4c41-9b04-09e1fb612bc9 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:38.655784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fada8f-0b52-4c41-9b04-09e1fb612bc9 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:38.662171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0d72e-d2e6-49a1-b547-0ef11c6b7633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:38.662971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d72e-d2e6-49a1-b547-0ef11c6b7633 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.663252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d72e-d2e6-49a1-b547-0ef11c6b7633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.663525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d72e-d2e6-49a1-b547-0ef11c6b7633 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.664282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0d72e-d2e6-49a1-b547-0ef11c6b7633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:38.664638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0d72e-d2e6-49a1-b547-0ef11c6b7633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:38.670101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0d72e-d2e6-49a1-b547-0ef11c6b7633 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:38.689538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1047/2121] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:26:38.691558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0d72e-d2e6-49a1-b547-0ef11c6b7633 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:38.708885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0d72e-d2e6-49a1-b547-0ef11c6b7633 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:38.716351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d819b6-9f1e-47f0-b1ec-8a07b0bde439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:38.717083 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d819b6-9f1e-47f0-b1ec-8a07b0bde439 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.717727 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d819b6-9f1e-47f0-b1ec-8a07b0bde439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.718148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d819b6-9f1e-47f0-b1ec-8a07b0bde439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.719016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d819b6-9f1e-47f0-b1ec-8a07b0bde439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:38.721132 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d819b6-9f1e-47f0-b1ec-8a07b0bde439 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:38.721887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9b6e6-3779-405a-8a1d-2e90ec25a6a9 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:38.727058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63cf3-c5e8-4601-8c4c-fe1bee8b7685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:38.727714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63cf3-c5e8-4601-8c4c-fe1bee8b7685 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.727989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63cf3-c5e8-4601-8c4c-fe1bee8b7685 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.729385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63cf3-c5e8-4601-8c4c-fe1bee8b7685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.732301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2bd63cf3-c5e8-4601-8c4c-fe1bee8b7685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:38.751068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd63cf3-c5e8-4601-8c4c-fe1bee8b7685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:38.753417 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd63cf3-c5e8-4601-8c4c-fe1bee8b7685 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:38.767091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1075/2122] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:38.849201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1048/2123] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:38 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:38.853107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63cf3-c5e8-4601-8c4c-fe1bee8b7685 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:38.868200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:38.884656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63cf3-c5e8-4601-8c4c-fe1bee8b7685 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:38.973700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc155e9-4c8a-43e8-b038-0258f6c0950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:38.974356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc155e9-4c8a-43e8-b038-0258f6c0950b admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:38.974786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc155e9-4c8a-43e8-b038-0258f6c0950b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:38.975069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc155e9-4c8a-43e8-b038-0258f6c0950b admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:38.977654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc155e9-4c8a-43e8-b038-0258f6c0950b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:38.993222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc155e9-4c8a-43e8-b038-0258f6c0950b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:39.000863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d819b6-9f1e-47f0-b1ec-8a07b0bde439 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:39.002811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e6d819b6-9f1e-47f0-b1ec-8a07b0bde439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:39.016839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d819b6-9f1e-47f0-b1ec-8a07b0bde439 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:39.028387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:39.029573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:39.030019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:39.030477 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] PATH_INFO: `/v3/projects/bd41986c224f414b8768675f40682380` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:39.031851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd41986c224f414b8768675f40682380)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:39.033901 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:39.146511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1076/2124] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:38 2022] POST /identity/v3/users => generated 284 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:39.149980 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc155e9-4c8a-43e8-b038-0258f6c0950b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:39.173142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd41986c224f414b8768675f40682380', 'request_id': 'req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.183469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc155e9-4c8a-43e8-b038-0258f6c0950b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:39.195806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd41986c224f414b8768675f40682380', 'request_id': 'req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.266703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28942f23-3fc9-4960-bbf2-087d2727355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:39.267911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28942f23-3fc9-4960-bbf2-087d2727355e admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:39.268220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28942f23-3fc9-4960-bbf2-087d2727355e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:39.268471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28942f23-3fc9-4960-bbf2-087d2727355e admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:39.269194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28942f23-3fc9-4960-bbf2-087d2727355e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:39.270894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28942f23-3fc9-4960-bbf2-087d2727355e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:39.287804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1077/2125] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:39.288791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28942f23-3fc9-4960-bbf2-087d2727355e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:39.291258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-28942f23-3fc9-4960-bbf2-087d2727355e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:39.307015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28942f23-3fc9-4960-bbf2-087d2727355e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:39.313150 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:39.313812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:39.314092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:39.314399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] PATH_INFO: `/v3/projects/25c77dd29e224d05a382cba94fc4d39d` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:39.315618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c77dd29e224d05a382cba94fc4d39d)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:39.317842 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:39.337675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd41986c224f414b8768675f40682380', 'request_id': 'req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.351098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] The token cache is being invalidate because project bd41986c224f414b8768675f40682380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:39.351308 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.352988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.355412 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1049/2126] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:38 2022] DELETE /identity/v3/projects/bd41986c224f414b8768675f40682380 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:39.357162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:39.360249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:39.376884 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed7cc3-b73c-4aa6-8ea9-b87ac9d740d3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:39.379749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e009c5e-4eba-4ed5-b002-9aa812a620b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:39.380391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e009c5e-4eba-4ed5-b002-9aa812a620b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:39.380675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e009c5e-4eba-4ed5-b002-9aa812a620b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:39.381100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e009c5e-4eba-4ed5-b002-9aa812a620b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:39.381815 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e009c5e-4eba-4ed5-b002-9aa812a620b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:39.383563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e009c5e-4eba-4ed5-b002-9aa812a620b8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:39.395788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1050/2127] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:39.402074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68cabf-3083-48a3-bb20-0525e41c0029 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:39.402074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68cabf-3083-48a3-bb20-0525e41c0029 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:39.402074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68cabf-3083-48a3-bb20-0525e41c0029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:39.423250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-7b68cabf-3083-48a3-bb20-0525e41c0029 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:39.424873 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7b68cabf-3083-48a3-bb20-0525e41c0029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:39.433729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1051/2128] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:39.434553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68cabf-3083-48a3-bb20-0525e41c0029 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:39.445441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68cabf-3083-48a3-bb20-0525e41c0029 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:39.450445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e417976-637e-4589-acc0-2a213eba6bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:39.451151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e417976-637e-4589-acc0-2a213eba6bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:39.451433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e417976-637e-4589-acc0-2a213eba6bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:39.451738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e417976-637e-4589-acc0-2a213eba6bd4 admin admin] PATH_INFO: `/v3/projects/526275ba9fa44d9ca7367097e8839ee4/users/7b69c3387cf44559a43ab86a93694703/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:39.467429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e417976-637e-4589-acc0-2a213eba6bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526275ba9fa44d9ca7367097e8839ee4, user_id=7b69c3387cf44559a43ab86a93694703, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:39.470132 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e417976-637e-4589-acc0-2a213eba6bd4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:39.480861 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c77dd29e224d05a382cba94fc4d39d', 'request_id': 'req-13350713-c090-4296-b8b0-528bb72a3fed'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.487887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c77dd29e224d05a382cba94fc4d39d', 'request_id': 'req-13350713-c090-4296-b8b0-528bb72a3fed'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.550127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c77dd29e224d05a382cba94fc4d39d', 'request_id': 'req-13350713-c090-4296-b8b0-528bb72a3fed'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.569288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] The token cache is being invalidate because project 25c77dd29e224d05a382cba94fc4d39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:39.570036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.574642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1052/2129] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:39 2022] PUT /identity/v3/projects/526275ba9fa44d9ca7367097e8839ee4/users/7b69c3387cf44559a43ab86a93694703/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:39.577021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3881d85-db06-449f-bbf3-20be72d34205 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:39.578416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3881d85-db06-449f-bbf3-20be72d34205 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:39.579042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3881d85-db06-449f-bbf3-20be72d34205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:39.596267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.599541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1078/2130] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:39 2022] DELETE /identity/v3/projects/25c77dd29e224d05a382cba94fc4d39d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:39.599956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:39.601459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:39.607615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-f3881d85-db06-449f-bbf3-20be72d34205 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:39.608980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f3881d85-db06-449f-bbf3-20be72d34205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:39.684496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1053/2131] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:39.685677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3959e-9bc0-4637-a16f-728945dc3524 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:39.685965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3959e-9bc0-4637-a16f-728945dc3524 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:39.686231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350713-c090-4296-b8b0-528bb72a3fed admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:39.686364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3959e-9bc0-4637-a16f-728945dc3524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:39.691829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:39.692483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:39.692761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:39.693032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] PATH_INFO: `/v3/projects/93c2235e14c4442ab798372ce8d6680b` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:39.694243 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c2235e14c4442ab798372ce8d6680b)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:39.696499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:39.727109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e0f3959e-9bc0-4637-a16f-728945dc3524 None None] MFA Rules not processed for user `7b69c3387cf44559a43ab86a93694703`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:39.730522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e0f3959e-9bc0-4637-a16f-728945dc3524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:39.806361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1054/2132] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:39.808157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3959e-9bc0-4637-a16f-728945dc3524 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:39.809526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e0f3959e-9bc0-4637-a16f-728945dc3524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:39.823381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3959e-9bc0-4637-a16f-728945dc3524 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:39.828022 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:39.828675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:39.828951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:39.829222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] PATH_INFO: `/v3/users/f6378acb2def4f798c24c7246109938b` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:39.830433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6378acb2def4f798c24c7246109938b)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:39.832417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:39.881076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c2235e14c4442ab798372ce8d6680b', 'request_id': 'req-03ba35c9-c2d6-4fba-a226-a8340e2616d5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:39.888586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c2235e14c4442ab798372ce8d6680b', 'request_id': 'req-03ba35c9-c2d6-4fba-a226-a8340e2616d5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.010783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c2235e14c4442ab798372ce8d6680b', 'request_id': 'req-03ba35c9-c2d6-4fba-a226-a8340e2616d5'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.023851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6378acb2def4f798c24c7246109938b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.024950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] The token cache is being invalidate because project 93c2235e14c4442ab798372ce8d6680b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:40.025264 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.026053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.026885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6378acb2def4f798c24c7246109938b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.027782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1079/2133] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:39 2022] DELETE /identity/v3/projects/93c2235e14c4442ab798372ce8d6680b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:40.028649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:40.035902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:40.036482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6378acb2def4f798c24c7246109938b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.037961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6378acb2def4f798c24c7246109938b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.122388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba35c9-c2d6-4fba-a226-a8340e2616d5 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:40.125713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6378acb2def4f798c24c7246109938b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.128151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56664ac7-5d75-4571-b95e-02906156e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:40.128775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56664ac7-5d75-4571-b95e-02906156e102 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:40.129053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56664ac7-5d75-4571-b95e-02906156e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:40.129323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56664ac7-5d75-4571-b95e-02906156e102 admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:40.130082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56664ac7-5d75-4571-b95e-02906156e102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:40.130458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56664ac7-5d75-4571-b95e-02906156e102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:40.136278 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56664ac7-5d75-4571-b95e-02906156e102 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:40.146529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1080/2134] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:40.147649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56664ac7-5d75-4571-b95e-02906156e102 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:40.149588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-56664ac7-5d75-4571-b95e-02906156e102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:40.156114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1055/2135] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:39 2022] DELETE /identity/v3/users/f6378acb2def4f798c24c7246109938b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:40.164925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:40.165590 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56664ac7-5d75-4571-b95e-02906156e102 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:40.167547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:40.246378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bac91-21fe-4af3-ace1-785be438516a admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:40.251077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e493f9-6f4e-4bb6-8505-bd85f8580982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:40.251645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:40.251783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e493f9-6f4e-4bb6-8505-bd85f8580982 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:40.251970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e493f9-6f4e-4bb6-8505-bd85f8580982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:40.252236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e493f9-6f4e-4bb6-8505-bd85f8580982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:40.252349 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:40.252561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:40.252839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] PATH_INFO: `/v3/users/58e862dabc6940b08f1f41b406fcef95` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:40.253125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e493f9-6f4e-4bb6-8505-bd85f8580982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:40.254173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e862dabc6940b08f1f41b406fcef95)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:40.256376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:40.256499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e493f9-6f4e-4bb6-8505-bd85f8580982 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:40.379222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1081/2136] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:40 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:40.379222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e493f9-6f4e-4bb6-8505-bd85f8580982 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:40.381283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-45e493f9-6f4e-4bb6-8505-bd85f8580982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:40.455793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e493f9-6f4e-4bb6-8505-bd85f8580982 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:40.460665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fd000-dcdd-471a-ba46-d23e1128d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:40.461286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fd000-dcdd-471a-ba46-d23e1128d29e admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:40.461558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fd000-dcdd-471a-ba46-d23e1128d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:40.461823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fd000-dcdd-471a-ba46-d23e1128d29e admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:40.462506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fd000-dcdd-471a-ba46-d23e1128d29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:40.464456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fd000-dcdd-471a-ba46-d23e1128d29e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:40.491464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e862dabc6940b08f1f41b406fcef95'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.492593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e862dabc6940b08f1f41b406fcef95'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.502890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e862dabc6940b08f1f41b406fcef95'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.503619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e862dabc6940b08f1f41b406fcef95'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.559397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1082/2137] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:40 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:40.559397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fd000-dcdd-471a-ba46-d23e1128d29e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:40.569801 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4d1fd000-dcdd-471a-ba46-d23e1128d29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:40.616809 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e862dabc6940b08f1f41b406fcef95'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:40.638410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1056/2138] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:40 2022] DELETE /identity/v3/users/58e862dabc6940b08f1f41b406fcef95 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:40.639469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:40.640834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:40.652993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fd000-dcdd-471a-ba46-d23e1128d29e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:40.715632 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaae9eb-8ecc-40eb-ab18-cac391816d97 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:40.723109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae631a-55c4-4aed-890a-1e818a888d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:40.723994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae631a-55c4-4aed-890a-1e818a888d8c admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:40.724478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae631a-55c4-4aed-890a-1e818a888d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:40.724827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae631a-55c4-4aed-890a-1e818a888d8c admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:40.725579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae631a-55c4-4aed-890a-1e818a888d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:40.727878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae631a-55c4-4aed-890a-1e818a888d8c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:40.771109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d30222-657d-4e6b-815e-37a5aa887d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:40.771743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d30222-657d-4e6b-815e-37a5aa887d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:40.772024 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d30222-657d-4e6b-815e-37a5aa887d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:40.772302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d30222-657d-4e6b-815e-37a5aa887d1c admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:40.772975 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d30222-657d-4e6b-815e-37a5aa887d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:40.773246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:40.774951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d30222-657d-4e6b-815e-37a5aa887d1c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:40.851984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1057/2139] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:40 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:40.852894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae631a-55c4-4aed-890a-1e818a888d8c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:40.856360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-10ae631a-55c4-4aed-890a-1e818a888d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:40.868834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae631a-55c4-4aed-890a-1e818a888d8c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:40.877005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:40.878084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:40.878621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:40.879342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] PATH_INFO: `/v3/projects/d1c99641b09444769655e0ff23ec756d` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:40.880832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c99641b09444769655e0ff23ec756d)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:40.883052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:40.885769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1083/2140] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:40 2022] POST /identity/v3/users => generated 290 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:40.888289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d30222-657d-4e6b-815e-37a5aa887d1c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:40.901312 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d30222-657d-4e6b-815e-37a5aa887d1c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:40.908778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c91ec2-18e3-4cbd-9193-1d7a7616e3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:40.910456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c91ec2-18e3-4cbd-9193-1d7a7616e3cf admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:40.910753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c91ec2-18e3-4cbd-9193-1d7a7616e3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:40.911026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c91ec2-18e3-4cbd-9193-1d7a7616e3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:40.912036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c91ec2-18e3-4cbd-9193-1d7a7616e3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:40.916125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c91ec2-18e3-4cbd-9193-1d7a7616e3cf admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:40.928936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1084/2141] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:40.930019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c91ec2-18e3-4cbd-9193-1d7a7616e3cf admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:40.944892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c91ec2-18e3-4cbd-9193-1d7a7616e3cf admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:40.951751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0525-6dec-4ae2-8dcf-eccd9d5b8486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:40.952372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0525-6dec-4ae2-8dcf-eccd9d5b8486 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:40.952680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0525-6dec-4ae2-8dcf-eccd9d5b8486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:40.953995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0525-6dec-4ae2-8dcf-eccd9d5b8486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:40.953995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c0525-6dec-4ae2-8dcf-eccd9d5b8486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:40.955290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c0525-6dec-4ae2-8dcf-eccd9d5b8486 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:40.968192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1085/2142] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:40.968192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0525-6dec-4ae2-8dcf-eccd9d5b8486 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:40.979948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0525-6dec-4ae2-8dcf-eccd9d5b8486 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:40.984964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff732b-6b01-4fc5-8fb7-2fa06c2a00d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:40.985683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff732b-6b01-4fc5-8fb7-2fa06c2a00d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:40.986010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff732b-6b01-4fc5-8fb7-2fa06c2a00d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:40.986409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff732b-6b01-4fc5-8fb7-2fa06c2a00d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:40.987176 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff732b-6b01-4fc5-8fb7-2fa06c2a00d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:40.988851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff732b-6b01-4fc5-8fb7-2fa06c2a00d1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:41.010333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1086/2143] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:41.011479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff732b-6b01-4fc5-8fb7-2fa06c2a00d1 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:41.016630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c99641b09444769655e0ff23ec756d', 'request_id': 'req-c0444b42-02e9-4337-978e-39ed54a5f93e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:41.024754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff732b-6b01-4fc5-8fb7-2fa06c2a00d1 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:41.025230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c99641b09444769655e0ff23ec756d', 'request_id': 'req-c0444b42-02e9-4337-978e-39ed54a5f93e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:41.090060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22be8d-59cb-4341-9a0a-151cd3edd7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:41.090748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22be8d-59cb-4341-9a0a-151cd3edd7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.091030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22be8d-59cb-4341-9a0a-151cd3edd7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.091303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22be8d-59cb-4341-9a0a-151cd3edd7f9 admin admin] PATH_INFO: `/v3/projects/10ba6dbfab2840728c248f6593e92da1/users/dac0c6dc676a4e229401cb5bb753bda4/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.107056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22be8d-59cb-4341-9a0a-151cd3edd7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ba6dbfab2840728c248f6593e92da1, user_id=dac0c6dc676a4e229401cb5bb753bda4, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:41.109722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22be8d-59cb-4341-9a0a-151cd3edd7f9 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:41.113812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c99641b09444769655e0ff23ec756d', 'request_id': 'req-c0444b42-02e9-4337-978e-39ed54a5f93e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:41.128285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] The token cache is being invalidate because project d1c99641b09444769655e0ff23ec756d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:41.128563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:41.129275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:41.134551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1058/2144] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:40 2022] DELETE /identity/v3/projects/d1c99641b09444769655e0ff23ec756d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:41.134551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:41.136879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:41.150870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444b42-02e9-4337-978e-39ed54a5f93e admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:41.156163 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616ff16-1ca1-4fac-882f-96b038302c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:41.156890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616ff16-1ca1-4fac-882f-96b038302c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.158345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616ff16-1ca1-4fac-882f-96b038302c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.158345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616ff16-1ca1-4fac-882f-96b038302c50 admin admin] PATH_INFO: `/v3/projects/d1ca4b83dc874bda9f33e06f4910608c/users/eb4dea95659c473b9b193c6234186430/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.176227 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616ff16-1ca1-4fac-882f-96b038302c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ca4b83dc874bda9f33e06f4910608c, user_id=eb4dea95659c473b9b193c6234186430, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:41.179000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616ff16-1ca1-4fac-882f-96b038302c50 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:41.246100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1087/2145] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:41 2022] PUT /identity/v3/projects/10ba6dbfab2840728c248f6593e92da1/users/dac0c6dc676a4e229401cb5bb753bda4/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:41.251589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca620e8-5465-4f0c-b462-bb04193045b6 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.251589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca620e8-5465-4f0c-b462-bb04193045b6 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.251589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca620e8-5465-4f0c-b462-bb04193045b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.281049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-7ca620e8-5465-4f0c-b462-bb04193045b6 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:41.282598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7ca620e8-5465-4f0c-b462-bb04193045b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:41.315278 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1059/2146] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:41 2022] PUT /identity/v3/projects/d1ca4b83dc874bda9f33e06f4910608c/users/eb4dea95659c473b9b193c6234186430/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:41.316579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616ff16-1ca1-4fac-882f-96b038302c50 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:41.318178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0616ff16-1ca1-4fac-882f-96b038302c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:41.337146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:41.356587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1088/2147] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:41.363713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca620e8-5465-4f0c-b462-bb04193045b6 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:41.367174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7ca620e8-5465-4f0c-b462-bb04193045b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:41.383807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca620e8-5465-4f0c-b462-bb04193045b6 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:41.412118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616ff16-1ca1-4fac-882f-96b038302c50 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:41.419046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:41.419914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.420826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.421255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] PATH_INFO: `/v3/projects/73db2abed4b3487898a2efe112130f72` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.422952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73db2abed4b3487898a2efe112130f72)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:41.425250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:41.469706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897082-07a7-4631-9a60-8dd99cafab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:41.470615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897082-07a7-4631-9a60-8dd99cafab7e admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.471030 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897082-07a7-4631-9a60-8dd99cafab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.471409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897082-07a7-4631-9a60-8dd99cafab7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.472263 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897082-07a7-4631-9a60-8dd99cafab7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:41.474355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897082-07a7-4631-9a60-8dd99cafab7e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:41.490702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1089/2148] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:41.490702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184e97d-a3cb-4ff5-813e-91ede72101ab None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.490702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184e97d-a3cb-4ff5-813e-91ede72101ab None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.490702 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184e97d-a3cb-4ff5-813e-91ede72101ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.508669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0184e97d-a3cb-4ff5-813e-91ede72101ab None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:41.509913 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0184e97d-a3cb-4ff5-813e-91ede72101ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:41.517788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1090/2149] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:41.519054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9acce-2d21-437c-b838-8f25a5649162 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.519331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9acce-2d21-437c-b838-8f25a5649162 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.519620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9acce-2d21-437c-b838-8f25a5649162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.540958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-8dc9acce-2d21-437c-b838-8f25a5649162 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:41.542811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8dc9acce-2d21-437c-b838-8f25a5649162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:41.545117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73db2abed4b3487898a2efe112130f72', 'request_id': 'req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:41.552193 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73db2abed4b3487898a2efe112130f72', 'request_id': 'req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:41.606584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1091/2150] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:41.607649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9acce-2d21-437c-b838-8f25a5649162 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:41.618628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9acce-2d21-437c-b838-8f25a5649162 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:41.624882 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673cc2c-2a46-45e0-b504-862523e6a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:41.625609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673cc2c-2a46-45e0-b504-862523e6a8da admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.626064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673cc2c-2a46-45e0-b504-862523e6a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.626262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673cc2c-2a46-45e0-b504-862523e6a8da admin admin] PATH_INFO: `/v3/projects/10ba6dbfab2840728c248f6593e92da1/users/dac0c6dc676a4e229401cb5bb753bda4/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.628242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673cc2c-2a46-45e0-b504-862523e6a8da admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ba6dbfab2840728c248f6593e92da1, user_id=dac0c6dc676a4e229401cb5bb753bda4, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:41.631318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673cc2c-2a46-45e0-b504-862523e6a8da admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:41.643614 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1092/2151] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:41 2022] PUT /identity/v3/projects/10ba6dbfab2840728c248f6593e92da1/users/dac0c6dc676a4e229401cb5bb753bda4/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:41.651802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673cc2c-2a46-45e0-b504-862523e6a8da admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:41.653324 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a673cc2c-2a46-45e0-b504-862523e6a8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:41.718390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673cc2c-2a46-45e0-b504-862523e6a8da admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:41.724198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85012875-8d7a-4c0d-a2f5-d64b99bcad0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:41.725147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012875-8d7a-4c0d-a2f5-d64b99bcad0f service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.725592 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012875-8d7a-4c0d-a2f5-d64b99bcad0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.726012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012875-8d7a-4c0d-a2f5-d64b99bcad0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.741936 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73db2abed4b3487898a2efe112130f72', 'request_id': 'req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:41.758365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] The token cache is being invalidate because project 73db2abed4b3487898a2efe112130f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:41.758681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:41.759440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:41.765003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1060/2152] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:41 2022] DELETE /identity/v3/projects/73db2abed4b3487898a2efe112130f72 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:41.765003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:41.765003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:41.778856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f2d3-fd80-4cf2-9e86-fdde108420a8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:41.824557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85012875-8d7a-4c0d-a2f5-d64b99bcad0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:41.827601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85012875-8d7a-4c0d-a2f5-d64b99bcad0f service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:41.843250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1093/2153] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:41.844280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85012875-8d7a-4c0d-a2f5-d64b99bcad0f service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:41.846087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-85012875-8d7a-4c0d-a2f5-d64b99bcad0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:41.861379 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85012875-8d7a-4c0d-a2f5-d64b99bcad0f service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:41.861776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888fd59-c1e6-4bf4-bdd6-f5575046ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:41.862070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888fd59-c1e6-4bf4-bdd6-f5575046ada3 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.862479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888fd59-c1e6-4bf4-bdd6-f5575046ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.862666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888fd59-c1e6-4bf4-bdd6-f5575046ada3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.863452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888fd59-c1e6-4bf4-bdd6-f5575046ada3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:41.863706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888fd59-c1e6-4bf4-bdd6-f5575046ada3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:41.866500 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888fd59-c1e6-4bf4-bdd6-f5575046ada3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:41.869611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:41.871843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.872418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.873042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] PATH_INFO: `/v3/users/53e4c3f223ec4e2fb9a4a474caa0b79d` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.875076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e4c3f223ec4e2fb9a4a474caa0b79d)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:41.877847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:41.886788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1061/2154] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:41.890652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0a151-13a7-4925-913e-ae99370af7e1 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:41.890652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0a151-13a7-4925-913e-ae99370af7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:41.890652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0a151-13a7-4925-913e-ae99370af7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:41.919113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-96b0a151-13a7-4925-913e-ae99370af7e1 None None] MFA Rules not processed for user `dac0c6dc676a4e229401cb5bb753bda4`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:41.920319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-96b0a151-13a7-4925-913e-ae99370af7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:41.999558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1062/2155] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:42.001245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0a151-13a7-4925-913e-ae99370af7e1 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:42.003396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-96b0a151-13a7-4925-913e-ae99370af7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:42.027416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0a151-13a7-4925-913e-ae99370af7e1 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:42.033339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:42.034079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:42.034688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:42.035322 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] PATH_INFO: `/v3/users/bbda6b26798a445bafc533dc09ea8bd1` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:42.036801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbda6b26798a445bafc533dc09ea8bd1)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:42.039191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:42.129876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e4c3f223ec4e2fb9a4a474caa0b79d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:42.130708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e4c3f223ec4e2fb9a4a474caa0b79d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:42.138125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e4c3f223ec4e2fb9a4a474caa0b79d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:42.152326 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e4c3f223ec4e2fb9a4a474caa0b79d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:42.269299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e4c3f223ec4e2fb9a4a474caa0b79d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:42.287321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1094/2156] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:41 2022] DELETE /identity/v3/users/53e4c3f223ec4e2fb9a4a474caa0b79d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:42.288309 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:42.292625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:42.318912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbda6b26798a445bafc533dc09ea8bd1'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:42.319898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbda6b26798a445bafc533dc09ea8bd1'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:42.348985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbda6b26798a445bafc533dc09ea8bd1'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:42.351271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbda6b26798a445bafc533dc09ea8bd1'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:42.404416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f885c8-2036-49b8-b8a9-999b35bd98c9 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:42.411128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9657d6-0dfb-47a4-92e7-a99441e07417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:42.411846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9657d6-0dfb-47a4-92e7-a99441e07417 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:42.412147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9657d6-0dfb-47a4-92e7-a99441e07417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:42.412418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9657d6-0dfb-47a4-92e7-a99441e07417 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:42.413191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9657d6-0dfb-47a4-92e7-a99441e07417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:42.415136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9657d6-0dfb-47a4-92e7-a99441e07417 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:42.531668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-44186524-0d49-48a2-8ef3-06d4b08df851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbda6b26798a445bafc533dc09ea8bd1'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:42.540500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1095/2157] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:42 2022] POST /identity/v3/projects => generated 389 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:42.545617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9657d6-0dfb-47a4-92e7-a99441e07417 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:42.546012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8f9657d6-0dfb-47a4-92e7-a99441e07417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:42.556168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1063/2158] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:41 2022] DELETE /identity/v3/users/bbda6b26798a445bafc533dc09ea8bd1 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:42.559362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b7dd-75b9-4c45-ae0d-26450c273f2b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:42.559859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b7dd-75b9-4c45-ae0d-26450c273f2b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:42.560207 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b7dd-75b9-4c45-ae0d-26450c273f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:42.585000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-5358b7dd-75b9-4c45-ae0d-26450c273f2b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:42.586922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5358b7dd-75b9-4c45-ae0d-26450c273f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:42.654264 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9657d6-0dfb-47a4-92e7-a99441e07417 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:42.690799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1064/2159] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:42.694574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b7dd-75b9-4c45-ae0d-26450c273f2b None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:42.698788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5358b7dd-75b9-4c45-ae0d-26450c273f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:42.729739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b7dd-75b9-4c45-ae0d-26450c273f2b None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:42.735027 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f088dea-0851-4daf-9015-d8df670e2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:42.735851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f088dea-0851-4daf-9015-d8df670e2734 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:42.736133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f088dea-0851-4daf-9015-d8df670e2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:42.737110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f088dea-0851-4daf-9015-d8df670e2734 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:42.737778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f088dea-0851-4daf-9015-d8df670e2734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:42.740563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f088dea-0851-4daf-9015-d8df670e2734 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:42.757407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ff35d-5f99-4711-af1f-c2cbc835be5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:42.758283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ff35d-5f99-4711-af1f-c2cbc835be5e service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:42.758647 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ff35d-5f99-4711-af1f-c2cbc835be5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:42.758931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ff35d-5f99-4711-af1f-c2cbc835be5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:42.761504 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-da2ff35d-5f99-4711-af1f-c2cbc835be5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:42.830828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ff35d-5f99-4711-af1f-c2cbc835be5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:42.832344 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ff35d-5f99-4711-af1f-c2cbc835be5e service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:42.841455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1065/2160] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:42 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:42.842745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1096/2161] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:42.845931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ff35d-5f99-4711-af1f-c2cbc835be5e service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:42.846201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f088dea-0851-4daf-9015-d8df670e2734 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:42.848170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6f088dea-0851-4daf-9015-d8df670e2734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:42.870342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ff35d-5f99-4711-af1f-c2cbc835be5e service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:42.872577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc12fb3-5187-4de7-973a-2b139fa8f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:42.873208 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc12fb3-5187-4de7-973a-2b139fa8f22b admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:42.873482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc12fb3-5187-4de7-973a-2b139fa8f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:42.873752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc12fb3-5187-4de7-973a-2b139fa8f22b admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:42.874539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc12fb3-5187-4de7-973a-2b139fa8f22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:42.876177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc12fb3-5187-4de7-973a-2b139fa8f22b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:42.891469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1097/2162] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:42.895282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc12fb3-5187-4de7-973a-2b139fa8f22b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:42.904695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc12fb3-5187-4de7-973a-2b139fa8f22b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:42.911512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101d3b7-0309-425c-a3ce-6d18805c372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:42.912287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101d3b7-0309-425c-a3ce-6d18805c372c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:42.912412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101d3b7-0309-425c-a3ce-6d18805c372c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:42.912664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101d3b7-0309-425c-a3ce-6d18805c372c admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:42.913419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101d3b7-0309-425c-a3ce-6d18805c372c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:42.915250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101d3b7-0309-425c-a3ce-6d18805c372c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:42.927204 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1098/2163] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:42.931442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f088dea-0851-4daf-9015-d8df670e2734 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:42.932188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101d3b7-0309-425c-a3ce-6d18805c372c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:42.937697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ff860-9540-49f7-8705-3cdca303ac04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:42.938360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff860-9540-49f7-8705-3cdca303ac04 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:42.938643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff860-9540-49f7-8705-3cdca303ac04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:42.939756 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff860-9540-49f7-8705-3cdca303ac04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:42.945581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101d3b7-0309-425c-a3ce-6d18805c372c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:42.953489 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6b120-48dc-4915-85ae-7cf1ab791247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:42.954399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ff860-9540-49f7-8705-3cdca303ac04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:42.954605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b120-48dc-4915-85ae-7cf1ab791247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:42.954836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b120-48dc-4915-85ae-7cf1ab791247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:42.955244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b120-48dc-4915-85ae-7cf1ab791247 admin admin] PATH_INFO: `/v3/projects/8445fa30f8e84499940e4a3586345a89/users/90d2b161326e4ebeba96343b3904a140/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:42.956274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ff860-9540-49f7-8705-3cdca303ac04 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:42.974373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1066/2164] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:42.979362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6b120-48dc-4915-85ae-7cf1ab791247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8445fa30f8e84499940e4a3586345a89, user_id=90d2b161326e4ebeba96343b3904a140, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:42.982958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6b120-48dc-4915-85ae-7cf1ab791247 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:43.001040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ff860-9540-49f7-8705-3cdca303ac04 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:43.002616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a00ff860-9540-49f7-8705-3cdca303ac04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:43.016591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ff860-9540-49f7-8705-3cdca303ac04 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:43.026467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c812c-537c-419c-8f69-ed4785cb771e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:43.027241 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c812c-537c-419c-8f69-ed4785cb771e service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:43.027744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c812c-537c-419c-8f69-ed4785cb771e service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:43.028047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c812c-537c-419c-8f69-ed4785cb771e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:43.029970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8a1c812c-537c-419c-8f69-ed4785cb771e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:43.082604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1099/2165] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:42 2022] PUT /identity/v3/projects/8445fa30f8e84499940e4a3586345a89/users/90d2b161326e4ebeba96343b3904a140/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:43.096858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5b118-e9f2-4748-86b2-b20c9b3cb2e1 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:43.097155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5b118-e9f2-4748-86b2-b20c9b3cb2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:43.097496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5b118-e9f2-4748-86b2-b20c9b3cb2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:43.107404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c812c-537c-419c-8f69-ed4785cb771e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:43.110550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c812c-537c-419c-8f69-ed4785cb771e service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:43.123633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1067/2166] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:43.151411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-cfd5b118-e9f2-4748-86b2-b20c9b3cb2e1 None None] MFA Rules not processed for user `90d2b161326e4ebeba96343b3904a140`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:43.152969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-cfd5b118-e9f2-4748-86b2-b20c9b3cb2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:43.278882 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1100/2167] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:43.284203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c812c-537c-419c-8f69-ed4785cb771e service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:43.299725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5b118-e9f2-4748-86b2-b20c9b3cb2e1 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:43.302598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-cfd5b118-e9f2-4748-86b2-b20c9b3cb2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:43.317153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c812c-537c-419c-8f69-ed4785cb771e service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:43.319144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:43.417659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0a26b-a5e9-4909-8ab4-afa334e7105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:43.418396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0a26b-a5e9-4909-8ab4-afa334e7105b admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:43.420806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0a26b-a5e9-4909-8ab4-afa334e7105b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:43.420806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0a26b-a5e9-4909-8ab4-afa334e7105b admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:43.420806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0a26b-a5e9-4909-8ab4-afa334e7105b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:43.421782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0a26b-a5e9-4909-8ab4-afa334e7105b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:43.435810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5b118-e9f2-4748-86b2-b20c9b3cb2e1 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:43.445538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:43.446279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:43.446583 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:43.449533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] PATH_INFO: `/v3/projects/295104afb0eb4811b21287e3dae72c63` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:43.449533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=295104afb0eb4811b21287e3dae72c63)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:43.451343 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:43.511667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1068/2168] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:43 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:43.516777 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0a26b-a5e9-4909-8ab4-afa334e7105b admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:43.595712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0a26b-a5e9-4909-8ab4-afa334e7105b admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:43.604713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba77d68-740c-40ba-9cf2-f38c5cf9eb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:43.605360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba77d68-740c-40ba-9cf2-f38c5cf9eb8d admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:43.606049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba77d68-740c-40ba-9cf2-f38c5cf9eb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:43.606049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba77d68-740c-40ba-9cf2-f38c5cf9eb8d admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:43.606636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba77d68-740c-40ba-9cf2-f38c5cf9eb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:43.608733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba77d68-740c-40ba-9cf2-f38c5cf9eb8d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:43.621938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '295104afb0eb4811b21287e3dae72c63', 'request_id': 'req-7e010e47-79e7-4394-aec5-c73b17788247'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:43.628572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '295104afb0eb4811b21287e3dae72c63', 'request_id': 'req-7e010e47-79e7-4394-aec5-c73b17788247'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:43.790102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '295104afb0eb4811b21287e3dae72c63', 'request_id': 'req-7e010e47-79e7-4394-aec5-c73b17788247'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:43.800236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1069/2169] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:43 2022] POST /identity/v3/users => generated 300 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:43.801233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba77d68-740c-40ba-9cf2-f38c5cf9eb8d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:43.809904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] The token cache is being invalidate because project 295104afb0eb4811b21287e3dae72c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:43.810487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:43.811465 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:43.821755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1101/2170] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:43 2022] DELETE /identity/v3/projects/295104afb0eb4811b21287e3dae72c63 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:43.825306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:43.825306 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:43.827897 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba77d68-740c-40ba-9cf2-f38c5cf9eb8d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:43.964330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e010e47-79e7-4394-aec5-c73b17788247 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:43.978036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:43.981221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02beae07-d7b6-4dda-82f7-6c80ea3bc7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:43.982812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beae07-d7b6-4dda-82f7-6c80ea3bc7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:43.983325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beae07-d7b6-4dda-82f7-6c80ea3bc7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:43.983841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beae07-d7b6-4dda-82f7-6c80ea3bc7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:43.983971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:43.985530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:43.986120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02beae07-d7b6-4dda-82f7-6c80ea3bc7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:43.987457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] PATH_INFO: `/v3/projects/0351fbcc2cd643a2ba7b504a34260209` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:43.990234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02beae07-d7b6-4dda-82f7-6c80ea3bc7c3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:43.991428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0351fbcc2cd643a2ba7b504a34260209)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:43.996152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:44.002016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:44.014954 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1070/2171] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:44.017449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221488-7f00-4d64-ad8e-1882d1b4819d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:44.017809 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221488-7f00-4d64-ad8e-1882d1b4819d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:44.018153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221488-7f00-4d64-ad8e-1882d1b4819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:44.079576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-42221488-7f00-4d64-ad8e-1882d1b4819d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:44.083960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-42221488-7f00-4d64-ad8e-1882d1b4819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:44.107921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1071/2172] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:44.108842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42221488-7f00-4d64-ad8e-1882d1b4819d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:44.111357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-42221488-7f00-4d64-ad8e-1882d1b4819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:44.136265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42221488-7f00-4d64-ad8e-1882d1b4819d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:44.193107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cf223-6a8b-464f-975c-fa5810882e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:44.210065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cf223-6a8b-464f-975c-fa5810882e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:44.210065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cf223-6a8b-464f-975c-fa5810882e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:44.210065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cf223-6a8b-464f-975c-fa5810882e7d admin admin] PATH_INFO: `/v3/projects/efd4360838d3451c892c150bdaa9e478/users/b51d1594b4474fac8e3d65c4364b21f8/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:44.236565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0351fbcc2cd643a2ba7b504a34260209', 'request_id': 'req-201cd47e-fac9-4999-a65c-100536f9f918'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:44.251946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0351fbcc2cd643a2ba7b504a34260209', 'request_id': 'req-201cd47e-fac9-4999-a65c-100536f9f918'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:44.266800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cf223-6a8b-464f-975c-fa5810882e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd4360838d3451c892c150bdaa9e478, user_id=b51d1594b4474fac8e3d65c4364b21f8, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:44.270471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cf223-6a8b-464f-975c-fa5810882e7d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:44.471378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0351fbcc2cd643a2ba7b504a34260209', 'request_id': 'req-201cd47e-fac9-4999-a65c-100536f9f918'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:44.480270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1072/2173] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:44 2022] PUT /identity/v3/projects/efd4360838d3451c892c150bdaa9e478/users/b51d1594b4474fac8e3d65c4364b21f8/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:44.483017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72d3f-1b19-4b2e-b7ee-8f8a44bcd910 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:44.483862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72d3f-1b19-4b2e-b7ee-8f8a44bcd910 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:44.485526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72d3f-1b19-4b2e-b7ee-8f8a44bcd910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:44.490501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] The token cache is being invalidate because project 0351fbcc2cd643a2ba7b504a34260209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:44.491004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:44.492159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:44.499304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1102/2174] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:43 2022] DELETE /identity/v3/projects/0351fbcc2cd643a2ba7b504a34260209 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:44.511149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:44.512871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:44.515961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-05e72d3f-1b19-4b2e-b7ee-8f8a44bcd910 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:44.517146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-05e72d3f-1b19-4b2e-b7ee-8f8a44bcd910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:44.600908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cd47e-fac9-4999-a65c-100536f9f918 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:44.604885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1073/2175] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:44.606241 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231aa884-ebf8-4b13-b495-46178848d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:44.607170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a82e-a0bb-4e88-a23b-1ffcd243d702 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:44.607302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa884-ebf8-4b13-b495-46178848d9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:44.607686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a82e-a0bb-4e88-a23b-1ffcd243d702 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:44.607808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa884-ebf8-4b13-b495-46178848d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:44.608177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a82e-a0bb-4e88-a23b-1ffcd243d702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:44.608729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa884-ebf8-4b13-b495-46178848d9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:44.609777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231aa884-ebf8-4b13-b495-46178848d9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:44.612107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231aa884-ebf8-4b13-b495-46178848d9e0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:44.629959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1103/2176] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:44.631129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231aa884-ebf8-4b13-b495-46178848d9e0 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:44.650259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231aa884-ebf8-4b13-b495-46178848d9e0 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:44.657478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744a3d0-29ec-424a-9360-97adab4b0056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:44.658818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744a3d0-29ec-424a-9360-97adab4b0056 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:44.659192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744a3d0-29ec-424a-9360-97adab4b0056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:44.659646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744a3d0-29ec-424a-9360-97adab4b0056 admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:44.660780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744a3d0-29ec-424a-9360-97adab4b0056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:44.661183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744a3d0-29ec-424a-9360-97adab4b0056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:44.663101 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744a3d0-29ec-424a-9360-97adab4b0056 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:44.683580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1104/2177] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:44.683580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744a3d0-29ec-424a-9360-97adab4b0056 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:44.688663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-13c4a82e-a0bb-4e88-a23b-1ffcd243d702 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:44.690158 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-13c4a82e-a0bb-4e88-a23b-1ffcd243d702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:44.713145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744a3d0-29ec-424a-9360-97adab4b0056 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:44.727863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1074/2178] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:44.729293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4a82e-a0bb-4e88-a23b-1ffcd243d702 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:44.742826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1bde-1b69-4030-95f4-de6d4d50310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:44.744998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1bde-1b69-4030-95f4-de6d4d50310d admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:44.745394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1bde-1b69-4030-95f4-de6d4d50310d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:44.745870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1bde-1b69-4030-95f4-de6d4d50310d admin admin] PATH_INFO: `/v3/projects/efd4360838d3451c892c150bdaa9e478/users/b51d1594b4474fac8e3d65c4364b21f8/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:44.749234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1bde-1b69-4030-95f4-de6d4d50310d admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd4360838d3451c892c150bdaa9e478, user_id=b51d1594b4474fac8e3d65c4364b21f8, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:44.753475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1bde-1b69-4030-95f4-de6d4d50310d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:44.754047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4a82e-a0bb-4e88-a23b-1ffcd243d702 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:44.777923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1105/2179] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:44 2022] PUT /identity/v3/projects/efd4360838d3451c892c150bdaa9e478/users/b51d1594b4474fac8e3d65c4364b21f8/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:44.788639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a9013-153a-4e75-828e-f10f8b6f756a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:44.790704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a9013-153a-4e75-828e-f10f8b6f756a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:44.792349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a9013-153a-4e75-828e-f10f8b6f756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:44.836862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-e34a9013-153a-4e75-828e-f10f8b6f756a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:44.839756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e34a9013-153a-4e75-828e-f10f8b6f756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:44.883422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d5a39-79b0-4abf-89df-26cc37d5f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:44.887180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d5a39-79b0-4abf-89df-26cc37d5f6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:44.889087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d5a39-79b0-4abf-89df-26cc37d5f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:44.889430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d5a39-79b0-4abf-89df-26cc37d5f6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:44.890411 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d5a39-79b0-4abf-89df-26cc37d5f6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:44.892501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d5a39-79b0-4abf-89df-26cc37d5f6b3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:44.937321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1106/2180] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:44.938741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd691999-69a3-4b5f-9282-69a4c1fd8dea None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:44.939098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd691999-69a3-4b5f-9282-69a4c1fd8dea None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:44.939442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd691999-69a3-4b5f-9282-69a4c1fd8dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:44.979767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-cd691999-69a3-4b5f-9282-69a4c1fd8dea None None] MFA Rules not processed for user `b51d1594b4474fac8e3d65c4364b21f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:44.981881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-cd691999-69a3-4b5f-9282-69a4c1fd8dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:45.012221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1075/2181] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:44 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:45.013174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d5a39-79b0-4abf-89df-26cc37d5f6b3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:45.133378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d5a39-79b0-4abf-89df-26cc37d5f6b3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:45.139933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740add58-e51e-48ef-9767-33180152e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:45.140722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740add58-e51e-48ef-9767-33180152e777 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:45.141121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740add58-e51e-48ef-9767-33180152e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:45.141505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740add58-e51e-48ef-9767-33180152e777 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:45.142521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740add58-e51e-48ef-9767-33180152e777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:45.148711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740add58-e51e-48ef-9767-33180152e777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:45.148711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740add58-e51e-48ef-9767-33180152e777 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:45.162795 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1107/2182] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:45.163796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd691999-69a3-4b5f-9282-69a4c1fd8dea None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:45.182137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1076/2183] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:45.183266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740add58-e51e-48ef-9767-33180152e777 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:45.186538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-740add58-e51e-48ef-9767-33180152e777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:45.200680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd691999-69a3-4b5f-9282-69a4c1fd8dea None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:45.214760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452e7b8-c876-43d7-8e29-4e6623797d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:45.215426 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452e7b8-c876-43d7-8e29-4e6623797d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:45.215695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452e7b8-c876-43d7-8e29-4e6623797d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:45.216015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452e7b8-c876-43d7-8e29-4e6623797d31 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:45.237115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452e7b8-c876-43d7-8e29-4e6623797d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:45.239491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452e7b8-c876-43d7-8e29-4e6623797d31 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:45.342336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740add58-e51e-48ef-9767-33180152e777 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:45.346615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a419cd-5a88-4f8f-a293-07e6fd5f666a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:45.347370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a419cd-5a88-4f8f-a293-07e6fd5f666a service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:45.347718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a419cd-5a88-4f8f-a293-07e6fd5f666a service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:45.348067 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a419cd-5a88-4f8f-a293-07e6fd5f666a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:45.362378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1108/2184] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:45 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:45.366605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452e7b8-c876-43d7-8e29-4e6623797d31 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:45.390878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452e7b8-c876-43d7-8e29-4e6623797d31 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:45.408827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8e625-e5f0-49ec-8bcb-cf1ef96a6ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:45.410235 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8e625-e5f0-49ec-8bcb-cf1ef96a6ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:45.415633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8e625-e5f0-49ec-8bcb-cf1ef96a6ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:45.417989 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8e625-e5f0-49ec-8bcb-cf1ef96a6ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:45.419027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8e625-e5f0-49ec-8bcb-cf1ef96a6ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:45.425728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8e625-e5f0-49ec-8bcb-cf1ef96a6ccd admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:45.442090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a419cd-5a88-4f8f-a293-07e6fd5f666a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:45.442090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a419cd-5a88-4f8f-a293-07e6fd5f666a service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:45.452066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1077/2185] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:45.453157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a419cd-5a88-4f8f-a293-07e6fd5f666a service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:45.465208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a419cd-5a88-4f8f-a293-07e6fd5f666a service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:45.471323 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a996784-2701-4d2d-9568-672db221abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:45.472401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a996784-2701-4d2d-9568-672db221abb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:45.472911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a996784-2701-4d2d-9568-672db221abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:45.473403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a996784-2701-4d2d-9568-672db221abb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:45.474400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a996784-2701-4d2d-9568-672db221abb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:45.476304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a996784-2701-4d2d-9568-672db221abb5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:45.495344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1078/2186] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:45.500328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a996784-2701-4d2d-9568-672db221abb5 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:45.527515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:45.532551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a996784-2701-4d2d-9568-672db221abb5 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:45.540191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1248f84-8ed7-4f86-9f77-722a22af18c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:45.541485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1248f84-8ed7-4f86-9f77-722a22af18c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:45.542002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1248f84-8ed7-4f86-9f77-722a22af18c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:45.542002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1248f84-8ed7-4f86-9f77-722a22af18c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:45.545671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1248f84-8ed7-4f86-9f77-722a22af18c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:45.550223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1248f84-8ed7-4f86-9f77-722a22af18c1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:45.585566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1109/2187] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:45 2022] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:45.589130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8e625-e5f0-49ec-8bcb-cf1ef96a6ccd admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:45.605100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1079/2188] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:45.610373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1248f84-8ed7-4f86-9f77-722a22af18c1 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:45.625752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1248f84-8ed7-4f86-9f77-722a22af18c1 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:45.748032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8e625-e5f0-49ec-8bcb-cf1ef96a6ccd admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:45.754125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f1b00-eec1-4310-b44a-e798e98db142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:45.754968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f1b00-eec1-4310-b44a-e798e98db142 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:45.755345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f1b00-eec1-4310-b44a-e798e98db142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:45.755811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f1b00-eec1-4310-b44a-e798e98db142 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:45.756712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f1b00-eec1-4310-b44a-e798e98db142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:45.760477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f1b00-eec1-4310-b44a-e798e98db142 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:45.811923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d76377-38fa-4a52-b170-7579036e8539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:45.813020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d76377-38fa-4a52-b170-7579036e8539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:45.813302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d76377-38fa-4a52-b170-7579036e8539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:45.814581 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d76377-38fa-4a52-b170-7579036e8539 admin admin] PATH_INFO: `/v3/projects/e32569df1dca45cebcdd63d03ff5abae/users/965cf2aad5bc4def9fca55aac87cc37e/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:45.833320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d76377-38fa-4a52-b170-7579036e8539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32569df1dca45cebcdd63d03ff5abae, user_id=965cf2aad5bc4def9fca55aac87cc37e, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:45.836861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d76377-38fa-4a52-b170-7579036e8539 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:45.873738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1110/2189] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:45 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:45.875446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f1b00-eec1-4310-b44a-e798e98db142 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:45.892502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f1b00-eec1-4310-b44a-e798e98db142 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:45.898856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:45.903259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:45.903259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:45.903259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] PATH_INFO: `/v3/users/90d2b161326e4ebeba96343b3904a140` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:45.903259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d2b161326e4ebeba96343b3904a140)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:45.904735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:45.979376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1080/2190] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:45 2022] PUT /identity/v3/projects/e32569df1dca45cebcdd63d03ff5abae/users/965cf2aad5bc4def9fca55aac87cc37e/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:45.981066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d76377-38fa-4a52-b170-7579036e8539 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:45.985697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-52d76377-38fa-4a52-b170-7579036e8539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:46.118880 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d2b161326e4ebeba96343b3904a140'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:46.123196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d2b161326e4ebeba96343b3904a140'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:46.139435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d2b161326e4ebeba96343b3904a140'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:46.156154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d76377-38fa-4a52-b170-7579036e8539 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:46.172760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:46.173745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:46.175812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:46.176018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] PATH_INFO: `/v3/users/dea93c6c505c48639d500a778c232347` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:46.178514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea93c6c505c48639d500a778c232347)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:46.182142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:46.185199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d2b161326e4ebeba96343b3904a140'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:46.292636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:46.325322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d2b161326e4ebeba96343b3904a140'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:46.334841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1111/2191] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:45 2022] DELETE /identity/v3/users/90d2b161326e4ebeba96343b3904a140 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:46.335587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:46.337274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:46.457246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea93c6c505c48639d500a778c232347'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:46.458648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea93c6c505c48639d500a778c232347'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:46.477233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea93c6c505c48639d500a778c232347'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:46.482025 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea93c6c505c48639d500a778c232347'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:46.496906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c66461-40e8-4eda-8509-7b4b2e7ef53e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:46.512598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9383c6d-a99a-4ff0-aab0-96fd369e6a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:46.522080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9383c6d-a99a-4ff0-aab0-96fd369e6a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:46.522080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9383c6d-a99a-4ff0-aab0-96fd369e6a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:46.522080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9383c6d-a99a-4ff0-aab0-96fd369e6a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:46.522080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9383c6d-a99a-4ff0-aab0-96fd369e6a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:46.522080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9383c6d-a99a-4ff0-aab0-96fd369e6a82 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:46.555419 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1112/2192] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:46.557594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386da818-04c6-404d-acda-a9df8e957ac3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:46.557874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386da818-04c6-404d-acda-a9df8e957ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:46.558151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386da818-04c6-404d-acda-a9df8e957ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:46.592363 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-386da818-04c6-404d-acda-a9df8e957ac3 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:46.593642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-386da818-04c6-404d-acda-a9df8e957ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:46.612543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea93c6c505c48639d500a778c232347'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:46.642571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1113/2193] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:46.658523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72747243-f380-472f-a2a0-319ade9cda76 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:46.658722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72747243-f380-472f-a2a0-319ade9cda76 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:46.660414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72747243-f380-472f-a2a0-319ade9cda76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:46.676149 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1081/2194] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:45 2022] DELETE /identity/v3/users/dea93c6c505c48639d500a778c232347 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:46.680015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:46.684130 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:46.710345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-72747243-f380-472f-a2a0-319ade9cda76 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:46.714610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-72747243-f380-472f-a2a0-319ade9cda76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:46.861374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1114/2195] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:46.862620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1005-c7da-4151-a12b-5250e85ff9a1 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:46.865660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72747243-f380-472f-a2a0-319ade9cda76 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:46.867196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-72747243-f380-472f-a2a0-319ade9cda76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:46.877786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78c6a5-c33d-4e56-b059-601cecfdba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:46.879378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c6a5-c33d-4e56-b059-601cecfdba6d admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:46.879842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c6a5-c33d-4e56-b059-601cecfdba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:46.880219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c6a5-c33d-4e56-b059-601cecfdba6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:46.881148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78c6a5-c33d-4e56-b059-601cecfdba6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:46.886152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78c6a5-c33d-4e56-b059-601cecfdba6d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:46.924401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1082/2196] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:46.925692 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78c6a5-c33d-4e56-b059-601cecfdba6d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:46.932666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9b78c6a5-c33d-4e56-b059-601cecfdba6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:46.993033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72747243-f380-472f-a2a0-319ade9cda76 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:46.997155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddb638-11ec-4623-b473-70b50bb40972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:46.997829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddb638-11ec-4623-b473-70b50bb40972 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:46.998130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddb638-11ec-4623-b473-70b50bb40972 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:46.998436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddb638-11ec-4623-b473-70b50bb40972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:47.009190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddb638-11ec-4623-b473-70b50bb40972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:47.012091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddb638-11ec-4623-b473-70b50bb40972 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:47.026578 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1115/2197] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:47.027671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddb638-11ec-4623-b473-70b50bb40972 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:47.035915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78c6a5-c33d-4e56-b059-601cecfdba6d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:47.040977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c857415-8da3-4fb8-9a3e-82b63970501e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:47.044600 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:47.045034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857415-8da3-4fb8-9a3e-82b63970501e service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:47.045336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857415-8da3-4fb8-9a3e-82b63970501e service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:47.045713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857415-8da3-4fb8-9a3e-82b63970501e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:47.053381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddb638-11ec-4623-b473-70b50bb40972 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:47.065513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c857415-8da3-4fb8-9a3e-82b63970501e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:47.069737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff49100-bdeb-419d-aa7e-0d1ceedcd55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:47.071687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff49100-bdeb-419d-aa7e-0d1ceedcd55f admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:47.077752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c857415-8da3-4fb8-9a3e-82b63970501e service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:47.077941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff49100-bdeb-419d-aa7e-0d1ceedcd55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:47.077941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff49100-bdeb-419d-aa7e-0d1ceedcd55f admin admin] PATH_INFO: `/v3/projects/39d875691ee24b4585415418774f6cbc/users/2786622da20840b69af845c9da9ecc3d/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:47.102596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1083/2198] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:47.110930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff49100-bdeb-419d-aa7e-0d1ceedcd55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d875691ee24b4585415418774f6cbc, user_id=2786622da20840b69af845c9da9ecc3d, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:47.114101 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff49100-bdeb-419d-aa7e-0d1ceedcd55f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:47.230075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1116/2199] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:47 2022] PUT /identity/v3/projects/39d875691ee24b4585415418774f6cbc/users/2786622da20840b69af845c9da9ecc3d/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:47.241421 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e8db-0e1f-41f8-82a4-f8327aa3d3f0 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:47.241967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e8db-0e1f-41f8-82a4-f8327aa3d3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:47.242497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e8db-0e1f-41f8-82a4-f8327aa3d3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:47.256608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff49100-bdeb-419d-aa7e-0d1ceedcd55f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:47.258819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4ff49100-bdeb-419d-aa7e-0d1ceedcd55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:47.284027 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-6666e8db-0e1f-41f8-82a4-f8327aa3d3f0 None None] MFA Rules not processed for user `2786622da20840b69af845c9da9ecc3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:47.285749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6666e8db-0e1f-41f8-82a4-f8327aa3d3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:47.347458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff49100-bdeb-419d-aa7e-0d1ceedcd55f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:47.353305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:47.354889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:47.355307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:47.355693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] PATH_INFO: `/v3/projects/08fdded0af804b53a8bb8cc7d7d1a8d2` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:47.358283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08fdded0af804b53a8bb8cc7d7d1a8d2)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:47.362920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:47.391124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1084/2200] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:47.401602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e8db-0e1f-41f8-82a4-f8327aa3d3f0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:47.403260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6666e8db-0e1f-41f8-82a4-f8327aa3d3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:47.545067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fdded0af804b53a8bb8cc7d7d1a8d2', 'request_id': 'req-30e88662-acb7-4401-ab3a-b87609895533'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:47.545682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e8db-0e1f-41f8-82a4-f8327aa3d3f0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:47.577593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fdded0af804b53a8bb8cc7d7d1a8d2', 'request_id': 'req-30e88662-acb7-4401-ab3a-b87609895533'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:47.682435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fdded0af804b53a8bb8cc7d7d1a8d2', 'request_id': 'req-30e88662-acb7-4401-ab3a-b87609895533'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:47.689058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefe3a5-1e93-44f1-92a3-af2daca4b3a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:47.689058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe3a5-1e93-44f1-92a3-af2daca4b3a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:47.689058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe3a5-1e93-44f1-92a3-af2daca4b3a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:47.689058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe3a5-1e93-44f1-92a3-af2daca4b3a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:47.705176 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] The token cache is being invalidate because project 08fdded0af804b53a8bb8cc7d7d1a8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:47.705947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:47.707050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:47.713257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1117/2201] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:47 2022] DELETE /identity/v3/projects/08fdded0af804b53a8bb8cc7d7d1a8d2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:47.717970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:47.717970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:47.800145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefe3a5-1e93-44f1-92a3-af2daca4b3a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:47.802277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefe3a5-1e93-44f1-92a3-af2daca4b3a3 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:47.807379 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e88662-acb7-4401-ab3a-b87609895533 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:47.813506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:47.814407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:47.814887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:47.815347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] PATH_INFO: `/v3/users/65fd64ecce71489d8ccf0d5e74a9ce43` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:47.816755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fd64ecce71489d8ccf0d5e74a9ce43)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:47.818932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:47.829254 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1085/2202] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:47.839698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefe3a5-1e93-44f1-92a3-af2daca4b3a3 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:47.842178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ceefe3a5-1e93-44f1-92a3-af2daca4b3a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:47.875951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefe3a5-1e93-44f1-92a3-af2daca4b3a3 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:47.891923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:47.891923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:47.891923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:47.902911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] PATH_INFO: `/v3/projects/8445fa30f8e84499940e4a3586345a89` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:47.902911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8445fa30f8e84499940e4a3586345a89)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:47.902911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:48.102986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fd64ecce71489d8ccf0d5e74a9ce43'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.104563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fd64ecce71489d8ccf0d5e74a9ce43'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.110126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8445fa30f8e84499940e4a3586345a89', 'request_id': 'req-babe07c4-9804-48ae-abc6-4979983da8cc'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.119658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fd64ecce71489d8ccf0d5e74a9ce43'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.127754 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8445fa30f8e84499940e4a3586345a89', 'request_id': 'req-babe07c4-9804-48ae-abc6-4979983da8cc'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.143270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fd64ecce71489d8ccf0d5e74a9ce43'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.269423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8445fa30f8e84499940e4a3586345a89', 'request_id': 'req-babe07c4-9804-48ae-abc6-4979983da8cc'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.284485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] The token cache is being invalidate because project 8445fa30f8e84499940e4a3586345a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:48.285395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.286280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.288200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1086/2203] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:47 2022] DELETE /identity/v3/projects/8445fa30f8e84499940e4a3586345a89 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:48.292744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:48.294137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:48.376473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe07c4-9804-48ae-abc6-4979983da8cc admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:48.381462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:48.382117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:48.382440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:48.382720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] PATH_INFO: `/v3/users/b51d1594b4474fac8e3d65c4364b21f8` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:48.383969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51d1594b4474fac8e3d65c4364b21f8)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:48.388076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:48.388482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fd64ecce71489d8ccf0d5e74a9ce43'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.401437 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1118/2204] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:47 2022] DELETE /identity/v3/users/65fd64ecce71489d8ccf0d5e74a9ce43 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:48.438231 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:48.666060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51d1594b4474fac8e3d65c4364b21f8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.666589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51d1594b4474fac8e3d65c4364b21f8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.673644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51d1594b4474fac8e3d65c4364b21f8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.674330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51d1594b4474fac8e3d65c4364b21f8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.799911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-266fc3ae-d7d7-455d-bb7b-00ac72855b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51d1594b4474fac8e3d65c4364b21f8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:48.824581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:48.831317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:48.861144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1087/2205] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:48 2022] DELETE /identity/v3/users/b51d1594b4474fac8e3d65c4364b21f8 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:48.975964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2c5b3-c6d7-464b-956e-eb57f90583b8 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:49.087196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:49.088477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:49.088760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:49.094870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] PATH_INFO: `/v3/projects/d5e7777eec2c4a81b86d322dd969dc4a` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:49.094870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e7777eec2c4a81b86d322dd969dc4a)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:49.094870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:49.329118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e7777eec2c4a81b86d322dd969dc4a', 'request_id': 'req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:49.353993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e7777eec2c4a81b86d322dd969dc4a', 'request_id': 'req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:49.561500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e7777eec2c4a81b86d322dd969dc4a', 'request_id': 'req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:49.583719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] The token cache is being invalidate because project d5e7777eec2c4a81b86d322dd969dc4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:49.583719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:49.583719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:49.585093 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1119/2206] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:48 2022] DELETE /identity/v3/projects/d5e7777eec2c4a81b86d322dd969dc4a => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:49.590156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acf25a-5539-4cc6-b3a3-cf3f8ff29c6c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:49.590476 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acf25a-5539-4cc6-b3a3-cf3f8ff29c6c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:49.590936 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acf25a-5539-4cc6-b3a3-cf3f8ff29c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:49.622777 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-77acf25a-5539-4cc6-b3a3-cf3f8ff29c6c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:49.622777 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-77acf25a-5539-4cc6-b3a3-cf3f8ff29c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:49.623284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:49.625959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:49.708651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1088/2207] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:49.717626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d24d08-8a52-43f5-9e73-c27285d448b2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:49.719829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d24d08-8a52-43f5-9e73-c27285d448b2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:49.720115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d24d08-8a52-43f5-9e73-c27285d448b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:49.770040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668da25e-f2ae-4f29-b70c-cdf0f1b16f1c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:49.777643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:49.778629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:49.779216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:49.779641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] PATH_INFO: `/v3/projects/efd4360838d3451c892c150bdaa9e478` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:49.781582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd4360838d3451c892c150bdaa9e478)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:49.793929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:49.794049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-88d24d08-8a52-43f5-9e73-c27285d448b2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:49.794049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-88d24d08-8a52-43f5-9e73-c27285d448b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:49.845368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1089/2208] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:49.849397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d24d08-8a52-43f5-9e73-c27285d448b2 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:49.889210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d24d08-8a52-43f5-9e73-c27285d448b2 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:49.901840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101fd14-28ab-466a-9431-f04c68dfdee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:49.902843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101fd14-28ab-466a-9431-f04c68dfdee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:49.903280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101fd14-28ab-466a-9431-f04c68dfdee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:49.903711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101fd14-28ab-466a-9431-f04c68dfdee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:49.904730 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101fd14-28ab-466a-9431-f04c68dfdee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:49.906056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101fd14-28ab-466a-9431-f04c68dfdee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:49.910598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101fd14-28ab-466a-9431-f04c68dfdee4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:49.949545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1090/2209] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:49.950920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101fd14-28ab-466a-9431-f04c68dfdee4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:49.992065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd4360838d3451c892c150bdaa9e478', 'request_id': 'req-af7d8fb8-3c7c-4d23-a73e-c8764c248974'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:49.992607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101fd14-28ab-466a-9431-f04c68dfdee4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:49.992711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd4360838d3451c892c150bdaa9e478', 'request_id': 'req-af7d8fb8-3c7c-4d23-a73e-c8764c248974'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:50.062158 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd4360838d3451c892c150bdaa9e478', 'request_id': 'req-af7d8fb8-3c7c-4d23-a73e-c8764c248974'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:50.087032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] The token cache is being invalidate because project efd4360838d3451c892c150bdaa9e478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:50.089635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:50.094273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:50.101632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1120/2210] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:49 2022] DELETE /identity/v3/projects/efd4360838d3451c892c150bdaa9e478 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:50.101632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:50.102397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:50.138366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbefb4f-13d0-4638-87ff-8dc4597d0396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:50.139040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbefb4f-13d0-4638-87ff-8dc4597d0396 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:50.139442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbefb4f-13d0-4638-87ff-8dc4597d0396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:50.141198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbefb4f-13d0-4638-87ff-8dc4597d0396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:50.142022 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbefb4f-13d0-4638-87ff-8dc4597d0396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:50.144103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbefb4f-13d0-4638-87ff-8dc4597d0396 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:50.293636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1091/2211] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:49 2022] POST /identity/v3/projects => generated 385 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:50.295165 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fef38-15f3-4fcd-984b-72bdc23393a8 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:50.295450 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fef38-15f3-4fcd-984b-72bdc23393a8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:50.297305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fef38-15f3-4fcd-984b-72bdc23393a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:50.308138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d8fb8-3c7c-4d23-a73e-c8764c248974 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:50.349301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c39fef38-15f3-4fcd-984b-72bdc23393a8 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:50.362344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c39fef38-15f3-4fcd-984b-72bdc23393a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:50.381127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:50.422529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:50.423251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:50.423533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:50.423808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] PATH_INFO: `/v3/users/7b69c3387cf44559a43ab86a93694703` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:50.427088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b69c3387cf44559a43ab86a93694703)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:50.430037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:50.532208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1092/2212] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:50.534991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fef38-15f3-4fcd-984b-72bdc23393a8 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:50.534991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c39fef38-15f3-4fcd-984b-72bdc23393a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:50.551123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fef38-15f3-4fcd-984b-72bdc23393a8 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:50.562829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdf16a-efc6-4965-b8a3-0b8f80dde49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:50.563686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf16a-efc6-4965-b8a3-0b8f80dde49a admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:50.564072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf16a-efc6-4965-b8a3-0b8f80dde49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:50.564402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf16a-efc6-4965-b8a3-0b8f80dde49a admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:50.568728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdf16a-efc6-4965-b8a3-0b8f80dde49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:50.568728 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdf16a-efc6-4965-b8a3-0b8f80dde49a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:50.675242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1093/2213] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:50 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:50.675242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca5bbf-6335-45c4-b78e-b64d52c07827 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:50.675242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca5bbf-6335-45c4-b78e-b64d52c07827 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:50.675242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca5bbf-6335-45c4-b78e-b64d52c07827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:50.720282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b69c3387cf44559a43ab86a93694703'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:50.721460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b69c3387cf44559a43ab86a93694703'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:50.734023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b69c3387cf44559a43ab86a93694703'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:50.735847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ceca5bbf-6335-45c4-b78e-b64d52c07827 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:50.737124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ceca5bbf-6335-45c4-b78e-b64d52c07827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:50.757928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b69c3387cf44559a43ab86a93694703'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:50.772938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1094/2214] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:50.774017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca5bbf-6335-45c4-b78e-b64d52c07827 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:50.776914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ceca5bbf-6335-45c4-b78e-b64d52c07827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:50.802737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca5bbf-6335-45c4-b78e-b64d52c07827 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:50.815152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db33e7e-ea7f-4aff-b1bf-7440bd5301a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:50.815791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33e7e-ea7f-4aff-b1bf-7440bd5301a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:50.816068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33e7e-ea7f-4aff-b1bf-7440bd5301a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:50.816333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33e7e-ea7f-4aff-b1bf-7440bd5301a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:50.817223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db33e7e-ea7f-4aff-b1bf-7440bd5301a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:50.819686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db33e7e-ea7f-4aff-b1bf-7440bd5301a7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:50.843807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1095/2215] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:50.845034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db33e7e-ea7f-4aff-b1bf-7440bd5301a7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:50.852279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b69c3387cf44559a43ab86a93694703'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:50.865740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1121/2216] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:50 2022] DELETE /identity/v3/users/7b69c3387cf44559a43ab86a93694703 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:50.866537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db33e7e-ea7f-4aff-b1bf-7440bd5301a7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:50.867055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:51.067608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0493-7552-4d0c-bd0f-9b03ce10e99b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:51.069835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a0136-d278-46a0-9708-598d83ef9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:51.070502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a0136-d278-46a0-9708-598d83ef9067 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:51.070969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a0136-d278-46a0-9708-598d83ef9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:51.071222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a0136-d278-46a0-9708-598d83ef9067 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:51.071950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a0136-d278-46a0-9708-598d83ef9067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:51.072440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a0136-d278-46a0-9708-598d83ef9067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:51.074086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a0136-d278-46a0-9708-598d83ef9067 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:51.075310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077bf5d-2a6c-4b27-8a56-54cb7ccf4ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:51.076173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bf5d-2a6c-4b27-8a56-54cb7ccf4ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:51.076454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bf5d-2a6c-4b27-8a56-54cb7ccf4ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:51.076785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bf5d-2a6c-4b27-8a56-54cb7ccf4ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:51.077513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077bf5d-2a6c-4b27-8a56-54cb7ccf4ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:51.080465 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077bf5d-2a6c-4b27-8a56-54cb7ccf4ac2 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:51.112019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1122/2217] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:51.113859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d065a35-e58b-4ccc-8d39-f09580ac2b1b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:51.116603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d065a35-e58b-4ccc-8d39-f09580ac2b1b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:51.117016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d065a35-e58b-4ccc-8d39-f09580ac2b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:51.121904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1096/2218] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:51.121904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a0136-d278-46a0-9708-598d83ef9067 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:51.139700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a0136-d278-46a0-9708-598d83ef9067 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:51.151947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df0df0-ddea-4d4a-85de-a81510fc6696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:51.156544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df0df0-ddea-4d4a-85de-a81510fc6696 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:51.156544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df0df0-ddea-4d4a-85de-a81510fc6696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:51.156544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df0df0-ddea-4d4a-85de-a81510fc6696 admin admin] PATH_INFO: `/v3/projects/3c797fc807fe45bb9c38b9bc3d50bada/users/d75645499e0049039d8f8665f3d6f9af/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:51.168043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-4d065a35-e58b-4ccc-8d39-f09580ac2b1b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:51.170851 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4d065a35-e58b-4ccc-8d39-f09580ac2b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:51.192185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df0df0-ddea-4d4a-85de-a81510fc6696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c797fc807fe45bb9c38b9bc3d50bada, user_id=d75645499e0049039d8f8665f3d6f9af, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:51.195226 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df0df0-ddea-4d4a-85de-a81510fc6696 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:51.201667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1123/2219] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:51.202548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d065a35-e58b-4ccc-8d39-f09580ac2b1b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:51.220727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d065a35-e58b-4ccc-8d39-f09580ac2b1b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:51.227563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1da0c3-ffbb-4830-8c56-524fd2c0e3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:51.227688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1da0c3-ffbb-4830-8c56-524fd2c0e3ee admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:51.227948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1da0c3-ffbb-4830-8c56-524fd2c0e3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:51.228241 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1da0c3-ffbb-4830-8c56-524fd2c0e3ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:51.229463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1da0c3-ffbb-4830-8c56-524fd2c0e3ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:51.231423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1da0c3-ffbb-4830-8c56-524fd2c0e3ee admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:51.318726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1097/2220] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:51 2022] PUT /identity/v3/projects/3c797fc807fe45bb9c38b9bc3d50bada/users/d75645499e0049039d8f8665f3d6f9af/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:51.320148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df0df0-ddea-4d4a-85de-a81510fc6696 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:51.326007 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-21df0df0-ddea-4d4a-85de-a81510fc6696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:51.450787 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1124/2221] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:51 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:51.453317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13504ea3-349d-4729-b3b3-55d262e8e10c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:51.453608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13504ea3-349d-4729-b3b3-55d262e8e10c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:51.455272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13504ea3-349d-4729-b3b3-55d262e8e10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:51.505047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df0df0-ddea-4d4a-85de-a81510fc6696 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:51.536016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-13504ea3-349d-4729-b3b3-55d262e8e10c None None] MFA Rules not processed for user `eb4dea95659c473b9b193c6234186430`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:51.541985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-13504ea3-349d-4729-b3b3-55d262e8e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:51.607092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb1638-e318-4ae8-909f-8c9f1370fc01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:51.607872 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1638-e318-4ae8-909f-8c9f1370fc01 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:51.610352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1638-e318-4ae8-909f-8c9f1370fc01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:51.618730 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1638-e318-4ae8-909f-8c9f1370fc01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:51.641104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:51.680481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1125/2222] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:51.682782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713ff5b-6f1d-49ce-843f-a2452fa8f096 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:51.683137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713ff5b-6f1d-49ce-843f-a2452fa8f096 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:51.683354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713ff5b-6f1d-49ce-843f-a2452fa8f096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:51.719000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-1713ff5b-6f1d-49ce-843f-a2452fa8f096 None None] MFA Rules not processed for user `d75645499e0049039d8f8665f3d6f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:51.720380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1713ff5b-6f1d-49ce-843f-a2452fa8f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:51.731368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb1638-e318-4ae8-909f-8c9f1370fc01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:51.732860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb1638-e318-4ae8-909f-8c9f1370fc01 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:51.754750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1098/2223] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:51.756125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb1638-e318-4ae8-909f-8c9f1370fc01 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:51.770807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb1638-e318-4ae8-909f-8c9f1370fc01 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:51.793740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73334c-48fa-438d-963e-c7e80edc2560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:51.794404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73334c-48fa-438d-963e-c7e80edc2560 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:51.794682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73334c-48fa-438d-963e-c7e80edc2560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:51.794917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73334c-48fa-438d-963e-c7e80edc2560 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:51.795594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73334c-48fa-438d-963e-c7e80edc2560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:51.798571 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73334c-48fa-438d-963e-c7e80edc2560 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:51.815560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1126/2224] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:51.817610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713ff5b-6f1d-49ce-843f-a2452fa8f096 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:51.819779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1713ff5b-6f1d-49ce-843f-a2452fa8f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:51.921722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1099/2225] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:51 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:51.923221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73334c-48fa-438d-963e-c7e80edc2560 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:51.927258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1d73334c-48fa-438d-963e-c7e80edc2560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:51.998195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713ff5b-6f1d-49ce-843f-a2452fa8f096 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:52.005915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04588d-6aab-4b9c-9bb2-b47546c13a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:52.006564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04588d-6aab-4b9c-9bb2-b47546c13a4b service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:52.007010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04588d-6aab-4b9c-9bb2-b47546c13a4b service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:52.007563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04588d-6aab-4b9c-9bb2-b47546c13a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:52.017183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04588d-6aab-4b9c-9bb2-b47546c13a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:52.018869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04588d-6aab-4b9c-9bb2-b47546c13a4b service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:52.030420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73334c-48fa-438d-963e-c7e80edc2560 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:52.031257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1127/2226] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:52.032186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04588d-6aab-4b9c-9bb2-b47546c13a4b service nova] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:52.038906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299d6f-8d99-448a-87e3-fafcc4b6c75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:52.039645 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299d6f-8d99-448a-87e3-fafcc4b6c75e service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:52.040083 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299d6f-8d99-448a-87e3-fafcc4b6c75e service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:52.040505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299d6f-8d99-448a-87e3-fafcc4b6c75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:52.046972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04588d-6aab-4b9c-9bb2-b47546c13a4b service nova] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:52.080188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11299d6f-8d99-448a-87e3-fafcc4b6c75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:52.083837 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11299d6f-8d99-448a-87e3-fafcc4b6c75e service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:52.086277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3aeaa-7d91-4446-beb6-94b9f1954905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:52.087528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3aeaa-7d91-4446-beb6-94b9f1954905 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:52.097240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3aeaa-7d91-4446-beb6-94b9f1954905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:52.097496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3aeaa-7d91-4446-beb6-94b9f1954905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:52.098255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3aeaa-7d91-4446-beb6-94b9f1954905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:52.099927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3aeaa-7d91-4446-beb6-94b9f1954905 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:52.125129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1100/2227] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:52.138182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1128/2228] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:52.142938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299d6f-8d99-448a-87e3-fafcc4b6c75e service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:52.158689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299d6f-8d99-448a-87e3-fafcc4b6c75e service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:52.180032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fc68e-6d95-4fa4-b85c-f33cddd78e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:52.183775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fc68e-6d95-4fa4-b85c-f33cddd78e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:52.183775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fc68e-6d95-4fa4-b85c-f33cddd78e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:52.183775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fc68e-6d95-4fa4-b85c-f33cddd78e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:52.183775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fc68e-6d95-4fa4-b85c-f33cddd78e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:52.184364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fc68e-6d95-4fa4-b85c-f33cddd78e57 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:52.238048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1101/2229] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:52.247431 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3aeaa-7d91-4446-beb6-94b9f1954905 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:52.268012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3aeaa-7d91-4446-beb6-94b9f1954905 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:52.303244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b00033-3dbe-4a81-bfff-288cb5169f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:52.304556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b00033-3dbe-4a81-bfff-288cb5169f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:52.314713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b00033-3dbe-4a81-bfff-288cb5169f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:52.315046 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b00033-3dbe-4a81-bfff-288cb5169f6d admin admin] PATH_INFO: `/v3/projects/bd3c870f4eb84f8f9eb237bee23e70ad/users/28b7f85f55c64dbd8b4ff8ca1eeb0a0b/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:52.450520 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b00033-3dbe-4a81-bfff-288cb5169f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3c870f4eb84f8f9eb237bee23e70ad, user_id=28b7f85f55c64dbd8b4ff8ca1eeb0a0b, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:52.453375 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b00033-3dbe-4a81-bfff-288cb5169f6d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:52.514236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fc68e-6d95-4fa4-b85c-f33cddd78e57 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:52.516723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-357fc68e-6d95-4fa4-b85c-f33cddd78e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:52.521573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1129/2230] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:52 2022] PUT /identity/v3/projects/bd3c870f4eb84f8f9eb237bee23e70ad/users/28b7f85f55c64dbd8b4ff8ca1eeb0a0b/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:52.535287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5fab1-ccbd-4ecb-b471-6d9e9f87eba8 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:52.535666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5fab1-ccbd-4ecb-b471-6d9e9f87eba8 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:52.536098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5fab1-ccbd-4ecb-b471-6d9e9f87eba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:52.548663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fc68e-6d95-4fa4-b85c-f33cddd78e57 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:52.675644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-67a5fab1-ccbd-4ecb-b471-6d9e9f87eba8 None None] MFA Rules not processed for user `28b7f85f55c64dbd8b4ff8ca1eeb0a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:52.687266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-67a5fab1-ccbd-4ecb-b471-6d9e9f87eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:52.733708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:52.734778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:52.741292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:52.741292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] PATH_INFO: `/v3/projects/526275ba9fa44d9ca7367097e8839ee4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:52.741292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=526275ba9fa44d9ca7367097e8839ee4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:52.741292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:52.883025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1130/2231] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:52.890537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526275ba9fa44d9ca7367097e8839ee4', 'request_id': 'req-71a3ee34-6e70-42e7-835c-60580a1181bb'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:52.890899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5fab1-ccbd-4ecb-b471-6d9e9f87eba8 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:52.905565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526275ba9fa44d9ca7367097e8839ee4', 'request_id': 'req-71a3ee34-6e70-42e7-835c-60580a1181bb'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:52.908677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5fab1-ccbd-4ecb-b471-6d9e9f87eba8 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:53.016907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526275ba9fa44d9ca7367097e8839ee4', 'request_id': 'req-71a3ee34-6e70-42e7-835c-60580a1181bb'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:53.031437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] The token cache is being invalidate because project 526275ba9fa44d9ca7367097e8839ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:53.032049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:53.032886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:53.036063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1102/2232] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:52 2022] DELETE /identity/v3/projects/526275ba9fa44d9ca7367097e8839ee4 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:53.039734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:53.042185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:53.085783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b2baf-bde0-485e-8b79-df9e38f0d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:53.086752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2baf-bde0-485e-8b79-df9e38f0d048 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:53.087891 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2baf-bde0-485e-8b79-df9e38f0d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:53.088588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2baf-bde0-485e-8b79-df9e38f0d048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:53.089580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b2baf-bde0-485e-8b79-df9e38f0d048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:53.093122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b2baf-bde0-485e-8b79-df9e38f0d048 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:53.127824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:53.233156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3ee34-6e70-42e7-835c-60580a1181bb admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:53.242964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:53.243625 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:53.244488 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:53.244776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] PATH_INFO: `/v3/users/dac0c6dc676a4e229401cb5bb753bda4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:53.245657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1131/2233] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:52 2022] POST /identity/v3/projects => generated 385 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:53.249893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac0c6dc676a4e229401cb5bb753bda4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:53.250517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b2baf-bde0-485e-8b79-df9e38f0d048 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:53.254418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:53.255929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-455b2baf-bde0-485e-8b79-df9e38f0d048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:53.499566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b2baf-bde0-485e-8b79-df9e38f0d048 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:53.518902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570b26a-294c-4051-b8ec-e9a718cf82b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:53.523686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570b26a-294c-4051-b8ec-e9a718cf82b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:53.523686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570b26a-294c-4051-b8ec-e9a718cf82b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:53.523686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570b26a-294c-4051-b8ec-e9a718cf82b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:53.527903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570b26a-294c-4051-b8ec-e9a718cf82b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:53.529977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570b26a-294c-4051-b8ec-e9a718cf82b7 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:53.579359 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac0c6dc676a4e229401cb5bb753bda4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:53.580115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac0c6dc676a4e229401cb5bb753bda4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:53.604570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac0c6dc676a4e229401cb5bb753bda4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:53.605366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac0c6dc676a4e229401cb5bb753bda4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:53.645884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1132/2234] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:53 2022] POST /identity/v3/users => generated 299 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:53.651835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570b26a-294c-4051-b8ec-e9a718cf82b7 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:53.656318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a570b26a-294c-4051-b8ec-e9a718cf82b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:53.705028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570b26a-294c-4051-b8ec-e9a718cf82b7 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:53.720595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f45538-6abe-47d7-8feb-cb91aa5b8d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:53.721335 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45538-6abe-47d7-8feb-cb91aa5b8d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:53.721617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45538-6abe-47d7-8feb-cb91aa5b8d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:53.724820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45538-6abe-47d7-8feb-cb91aa5b8d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:53.725623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f45538-6abe-47d7-8feb-cb91aa5b8d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:53.726419 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac0c6dc676a4e229401cb5bb753bda4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:53.731564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f45538-6abe-47d7-8feb-cb91aa5b8d4c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:53.758531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1103/2235] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:53 2022] DELETE /identity/v3/users/dac0c6dc676a4e229401cb5bb753bda4 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:53.774804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1133/2236] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:53.775200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:53.929115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054d6f0-183a-4540-95dc-debc8615871d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:53.948982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b359f-5956-4ae5-9aa9-b2658c16d0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:53.949663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b359f-5956-4ae5-9aa9-b2658c16d0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:53.950417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b359f-5956-4ae5-9aa9-b2658c16d0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:53.950700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b359f-5956-4ae5-9aa9-b2658c16d0e6 admin admin] PATH_INFO: `/v3/projects/80059635594246cf96d7c5b2a2bd36fc/users/4a8f50333041452089f178f8bcf2b7ce/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:53.977826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b359f-5956-4ae5-9aa9-b2658c16d0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80059635594246cf96d7c5b2a2bd36fc, user_id=4a8f50333041452089f178f8bcf2b7ce, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:53.983308 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b359f-5956-4ae5-9aa9-b2658c16d0e6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:54.101549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1104/2237] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:53 2022] PUT /identity/v3/projects/80059635594246cf96d7c5b2a2bd36fc/users/4a8f50333041452089f178f8bcf2b7ce/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:54.105814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f45538-6abe-47d7-8feb-cb91aa5b8d4c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:54.120703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f45538-6abe-47d7-8feb-cb91aa5b8d4c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:54.266015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16c601-250f-4411-9d56-7340b1fc6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:54.266683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16c601-250f-4411-9d56-7340b1fc6b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:54.266963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16c601-250f-4411-9d56-7340b1fc6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:54.267240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16c601-250f-4411-9d56-7340b1fc6b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:54.268031 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16c601-250f-4411-9d56-7340b1fc6b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:54.275752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16c601-250f-4411-9d56-7340b1fc6b11 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:54.301388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1134/2238] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:54.305771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b359f-5956-4ae5-9aa9-b2658c16d0e6 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:54.326630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b359f-5956-4ae5-9aa9-b2658c16d0e6 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:54.358225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f1325-a44f-47eb-9236-8423f87094c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:54.363642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1325-a44f-47eb-9236-8423f87094c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:54.363642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1325-a44f-47eb-9236-8423f87094c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:54.363642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1325-a44f-47eb-9236-8423f87094c1 admin admin] PATH_INFO: `/v3/projects/80059635594246cf96d7c5b2a2bd36fc/users/4a8f50333041452089f178f8bcf2b7ce/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:54.363642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f1325-a44f-47eb-9236-8423f87094c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80059635594246cf96d7c5b2a2bd36fc, user_id=4a8f50333041452089f178f8bcf2b7ce, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:54.365237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f1325-a44f-47eb-9236-8423f87094c1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:54.380719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1105/2239] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:54 2022] PUT /identity/v3/projects/80059635594246cf96d7c5b2a2bd36fc/users/4a8f50333041452089f178f8bcf2b7ce/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:54.391503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7d9ce-a39d-46d6-bf50-cf4a72ccf704 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:54.392200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7d9ce-a39d-46d6-bf50-cf4a72ccf704 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:54.392483 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7d9ce-a39d-46d6-bf50-cf4a72ccf704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:54.468808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a1c7d9ce-a39d-46d6-bf50-cf4a72ccf704 None None] MFA Rules not processed for user `4a8f50333041452089f178f8bcf2b7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:54.470051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a1c7d9ce-a39d-46d6-bf50-cf4a72ccf704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:54.612100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1135/2240] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:54.622394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:54.661344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f1325-a44f-47eb-9236-8423f87094c1 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:54.663225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1b3f1325-a44f-47eb-9236-8423f87094c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:54.787553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f1325-a44f-47eb-9236-8423f87094c1 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:54.799801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b154c-76be-41f7-b164-140956f3c8d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:54.800786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b154c-76be-41f7-b164-140956f3c8d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:54.801623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b154c-76be-41f7-b164-140956f3c8d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:54.802390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b154c-76be-41f7-b164-140956f3c8d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:54.827938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b154c-76be-41f7-b164-140956f3c8d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:54.829816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b154c-76be-41f7-b164-140956f3c8d6 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:54.873202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1106/2241] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:55.230330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:55.246579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7d9ce-a39d-46d6-bf50-cf4a72ccf704 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:55.248570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a1c7d9ce-a39d-46d6-bf50-cf4a72ccf704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:55.443061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7d9ce-a39d-46d6-bf50-cf4a72ccf704 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:55.459143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:55.460065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:55.460501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:55.460921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] PATH_INFO: `/v3/projects/10ba6dbfab2840728c248f6593e92da1` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:55.464120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ba6dbfab2840728c248f6593e92da1)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:55.466356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:55.692936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ba6dbfab2840728c248f6593e92da1', 'request_id': 'req-7bbb0516-315f-4ee5-bee6-f6f2574b424f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:55.707078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ba6dbfab2840728c248f6593e92da1', 'request_id': 'req-7bbb0516-315f-4ee5-bee6-f6f2574b424f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:55.834467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ba6dbfab2840728c248f6593e92da1', 'request_id': 'req-7bbb0516-315f-4ee5-bee6-f6f2574b424f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:55.860933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] The token cache is being invalidate because project 10ba6dbfab2840728c248f6593e92da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:55.861327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:55.869973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7bbb0516-315f-4ee5-bee6-f6f2574b424f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:55.883526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1136/2242] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:55 2022] DELETE /identity/v3/projects/10ba6dbfab2840728c248f6593e92da1 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:55.886885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67419-c049-490f-8407-7573ecf82dde None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:55.887393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67419-c049-490f-8407-7573ecf82dde None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:55.888107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67419-c049-490f-8407-7573ecf82dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:55.959711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e7a67419-c049-490f-8407-7573ecf82dde None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:55.965009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e7a67419-c049-490f-8407-7573ecf82dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:56.111898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1107/2243] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:56.121498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808eb9-1144-4f7e-b483-03104f7a79ec None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:56.121794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808eb9-1144-4f7e-b483-03104f7a79ec None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:56.122084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808eb9-1144-4f7e-b483-03104f7a79ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:56.189371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ce808eb9-1144-4f7e-b483-03104f7a79ec None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:56.191356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ce808eb9-1144-4f7e-b483-03104f7a79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:56.212862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1137/2244] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:56.216783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a67419-c049-490f-8407-7573ecf82dde None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:56.235392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a67419-c049-490f-8407-7573ecf82dde None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:56.258596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440774e-c2a3-453f-9c2e-7c66e285260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:56.259897 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440774e-c2a3-453f-9c2e-7c66e285260d admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:56.262143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440774e-c2a3-453f-9c2e-7c66e285260d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:56.262612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440774e-c2a3-453f-9c2e-7c66e285260d admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:56.268002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440774e-c2a3-453f-9c2e-7c66e285260d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:56.268002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440774e-c2a3-453f-9c2e-7c66e285260d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:56.269102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440774e-c2a3-453f-9c2e-7c66e285260d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:56.298150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1108/2245] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:56.302212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce808eb9-1144-4f7e-b483-03104f7a79ec None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:56.319371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce808eb9-1144-4f7e-b483-03104f7a79ec None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:56.330072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408a90f-8b29-4ed1-988e-805ca14d3fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:56.331033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408a90f-8b29-4ed1-988e-805ca14d3fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:56.331481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408a90f-8b29-4ed1-988e-805ca14d3fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:56.331906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408a90f-8b29-4ed1-988e-805ca14d3fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:56.332922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408a90f-8b29-4ed1-988e-805ca14d3fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:56.336205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408a90f-8b29-4ed1-988e-805ca14d3fe0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:56.499385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440774e-c2a3-453f-9c2e-7c66e285260d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:56.499836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1138/2246] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:56 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:56.512343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440774e-c2a3-453f-9c2e-7c66e285260d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:56.706511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a6cec-30cb-4203-b9c5-18ac06bcccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:56.707646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a6cec-30cb-4203-b9c5-18ac06bcccf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:56.708249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a6cec-30cb-4203-b9c5-18ac06bcccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:56.708683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a6cec-30cb-4203-b9c5-18ac06bcccf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:56.709965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a6cec-30cb-4203-b9c5-18ac06bcccf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:56.714079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a6cec-30cb-4203-b9c5-18ac06bcccf8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:56.877178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1109/2247] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:56 2022] POST /identity/v3/users => generated 288 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:56.885447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408a90f-8b29-4ed1-988e-805ca14d3fe0 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:56.898863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408a90f-8b29-4ed1-988e-805ca14d3fe0 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:56.926852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7a47-e071-4c17-83b1-188c269964fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:56.926852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7a47-e071-4c17-83b1-188c269964fc admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:56.926852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7a47-e071-4c17-83b1-188c269964fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:56.926852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7a47-e071-4c17-83b1-188c269964fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:56.927368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f7a47-e071-4c17-83b1-188c269964fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:56.927368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f7a47-e071-4c17-83b1-188c269964fc admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:56.944067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1139/2248] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:56.948984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a6cec-30cb-4203-b9c5-18ac06bcccf8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:56.965803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a6cec-30cb-4203-b9c5-18ac06bcccf8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:57.000326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951da0-bba1-4114-9615-3e00a06073ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:57.000326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951da0-bba1-4114-9615-3e00a06073ba admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:57.000326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951da0-bba1-4114-9615-3e00a06073ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:57.000326 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951da0-bba1-4114-9615-3e00a06073ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:57.000866 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b951da0-bba1-4114-9615-3e00a06073ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:57.002762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b951da0-bba1-4114-9615-3e00a06073ba admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:57.039856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1110/2249] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:57.046249 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7a47-e071-4c17-83b1-188c269964fc admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:57.072100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7a47-e071-4c17-83b1-188c269964fc admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:57.094528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b81836-dbb3-431a-a083-16e4ce016b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:57.096475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81836-dbb3-431a-a083-16e4ce016b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:57.096865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81836-dbb3-431a-a083-16e4ce016b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:57.097247 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81836-dbb3-431a-a083-16e4ce016b42 admin admin] PATH_INFO: `/v3/projects/a2707c13a13d48c0b0f2ca16cd9946a3/users/00ff08bdc73a4f0b940a54d449f6b92d/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:57.126096 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b81836-dbb3-431a-a083-16e4ce016b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2707c13a13d48c0b0f2ca16cd9946a3, user_id=00ff08bdc73a4f0b940a54d449f6b92d, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:57.130007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b81836-dbb3-431a-a083-16e4ce016b42 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:57.250486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1140/2250] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:57 2022] PUT /identity/v3/projects/a2707c13a13d48c0b0f2ca16cd9946a3/users/00ff08bdc73a4f0b940a54d449f6b92d/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:57.258197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fd99f-6148-46a9-b2fa-c13dc36538f8 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:57.258627 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fd99f-6148-46a9-b2fa-c13dc36538f8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:57.259108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fd99f-6148-46a9-b2fa-c13dc36538f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:57.303985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d40fd99f-6148-46a9-b2fa-c13dc36538f8 None None] MFA Rules not processed for user `00ff08bdc73a4f0b940a54d449f6b92d`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:57.305274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d40fd99f-6148-46a9-b2fa-c13dc36538f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:57.355631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:57.388848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edac86a-7a7e-44bd-a069-c670a79ee45b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:57.389478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edac86a-7a7e-44bd-a069-c670a79ee45b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:57.389824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edac86a-7a7e-44bd-a069-c670a79ee45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:57.413895 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9edac86a-7a7e-44bd-a069-c670a79ee45b None None] MFA Rules not processed for user `eb4dea95659c473b9b193c6234186430`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:57.415339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9edac86a-7a7e-44bd-a069-c670a79ee45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:57.490400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1111/2251] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:57.502006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fd99f-6148-46a9-b2fa-c13dc36538f8 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:57.503803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d40fd99f-6148-46a9-b2fa-c13dc36538f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:57.563627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1141/2252] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:57.624832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:57.727979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fd99f-6148-46a9-b2fa-c13dc36538f8 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:57.735041 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ead0e4-c9b3-4320-b3cf-79c924ff9e37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc9a884f16149cda246ea9638621296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:57.736559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead0e4-c9b3-4320-b3cf-79c924ff9e37 service glance] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:57.737069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead0e4-c9b3-4320-b3cf-79c924ff9e37 service glance] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:57.737552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead0e4-c9b3-4320-b3cf-79c924ff9e37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:57.751858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ead0e4-c9b3-4320-b3cf-79c924ff9e37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:57.756235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ead0e4-c9b3-4320-b3cf-79c924ff9e37 service glance] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:57.779553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1112/2253] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:57.799972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509058d-b6ec-44e1-9c23-25b875d27b01 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:57.800258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509058d-b6ec-44e1-9c23-25b875d27b01 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:57.800535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509058d-b6ec-44e1-9c23-25b875d27b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:57.863247 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a509058d-b6ec-44e1-9c23-25b875d27b01 None None] MFA Rules not processed for user `965cf2aad5bc4def9fca55aac87cc37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:57.866051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a509058d-b6ec-44e1-9c23-25b875d27b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:57.982241 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1142/2254] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:57.982943 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ead0e4-c9b3-4320-b3cf-79c924ff9e37 service glance] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:57.984666 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-77ead0e4-c9b3-4320-b3cf-79c924ff9e37 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:58.095013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ead0e4-c9b3-4320-b3cf-79c924ff9e37 service glance] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:58.107489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6eaf-1238-4709-8bcf-ef184f952102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:58.108163 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6eaf-1238-4709-8bcf-ef184f952102 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:58.108800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6eaf-1238-4709-8bcf-ef184f952102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:58.110253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6eaf-1238-4709-8bcf-ef184f952102 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:58.111135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b6eaf-1238-4709-8bcf-ef184f952102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:58.113641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b6eaf-1238-4709-8bcf-ef184f952102 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:58.212736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509058d-b6ec-44e1-9c23-25b875d27b01 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:58.221945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1113/2255] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:57 2022] POST /identity/v3/projects => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:58.236796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509058d-b6ec-44e1-9c23-25b875d27b01 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:58.342749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6793c4d-d6b2-4137-8062-6f11c9acc3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:58.343385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6793c4d-d6b2-4137-8062-6f11c9acc3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:58.343661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6793c4d-d6b2-4137-8062-6f11c9acc3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:58.343934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6793c4d-d6b2-4137-8062-6f11c9acc3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:58.344603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6793c4d-d6b2-4137-8062-6f11c9acc3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:58.347262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6793c4d-d6b2-4137-8062-6f11c9acc3b4 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:58.353630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:58.453569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1143/2256] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:58 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:58.465253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6eaf-1238-4709-8bcf-ef184f952102 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:58.481021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6eaf-1238-4709-8bcf-ef184f952102 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:58.488215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f056941-99de-4f96-9264-b4b236eba846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:58.489313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f056941-99de-4f96-9264-b4b236eba846 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:58.489761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f056941-99de-4f96-9264-b4b236eba846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:58.490188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f056941-99de-4f96-9264-b4b236eba846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:58.492187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f056941-99de-4f96-9264-b4b236eba846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:58.495367 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f056941-99de-4f96-9264-b4b236eba846 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:58.514394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1114/2257] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:58.517481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6793c4d-d6b2-4137-8062-6f11c9acc3b4 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:58.550611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6793c4d-d6b2-4137-8062-6f11c9acc3b4 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:58.558121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13945796-ec95-4291-9920-5b05647ae186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:58.559879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13945796-ec95-4291-9920-5b05647ae186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:58.560331 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13945796-ec95-4291-9920-5b05647ae186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:58.561089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13945796-ec95-4291-9920-5b05647ae186 admin admin] PATH_INFO: `/v3/projects/a68c71fa88104e14a9b840fa7c64de64/users/bbf747c57a314a9f9c3546ca5409d543/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:58.579348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13945796-ec95-4291-9920-5b05647ae186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68c71fa88104e14a9b840fa7c64de64, user_id=bbf747c57a314a9f9c3546ca5409d543, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:58.582343 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13945796-ec95-4291-9920-5b05647ae186 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:58.655999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1144/2258] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:58 2022] PUT /identity/v3/projects/a68c71fa88104e14a9b840fa7c64de64/users/bbf747c57a314a9f9c3546ca5409d543/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:58.660084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f056941-99de-4f96-9264-b4b236eba846 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:58.671092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f056941-99de-4f96-9264-b4b236eba846 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:58.755180 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed021-49a3-4ab2-881e-357cdc023789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:58.755814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed021-49a3-4ab2-881e-357cdc023789 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:58.756094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed021-49a3-4ab2-881e-357cdc023789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:58.756369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed021-49a3-4ab2-881e-357cdc023789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:58.757212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed021-49a3-4ab2-881e-357cdc023789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:58.758962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed021-49a3-4ab2-881e-357cdc023789 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:58.775449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1115/2259] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:26:58.780871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13945796-ec95-4291-9920-5b05647ae186 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:58.804590 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13945796-ec95-4291-9920-5b05647ae186 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:58.811517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa22d48-732a-46a8-9e5e-d5a4284bd9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:58.812344 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa22d48-732a-46a8-9e5e-d5a4284bd9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:58.812782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa22d48-732a-46a8-9e5e-d5a4284bd9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:58.813203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa22d48-732a-46a8-9e5e-d5a4284bd9e0 admin admin] PATH_INFO: `/v3/projects/a68c71fa88104e14a9b840fa7c64de64/users/bbf747c57a314a9f9c3546ca5409d543/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:58.820313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa22d48-732a-46a8-9e5e-d5a4284bd9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68c71fa88104e14a9b840fa7c64de64, user_id=bbf747c57a314a9f9c3546ca5409d543, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:58.821878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa22d48-732a-46a8-9e5e-d5a4284bd9e0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:58.851510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1145/2260] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:58 2022] PUT /identity/v3/projects/a68c71fa88104e14a9b840fa7c64de64/users/bbf747c57a314a9f9c3546ca5409d543/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:59.275773 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed021-49a3-4ab2-881e-357cdc023789 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:59.277819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b40ed021-49a3-4ab2-881e-357cdc023789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:59.292303 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed021-49a3-4ab2-881e-357cdc023789 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:59.340990 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:59.398406 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:59.399339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:59.402835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:59.402835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] PATH_INFO: `/v3/users/28b7f85f55c64dbd8b4ff8ca1eeb0a0b` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:59.402835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b7f85f55c64dbd8b4ff8ca1eeb0a0b)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:59.405169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:59.662940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b7f85f55c64dbd8b4ff8ca1eeb0a0b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:59.663706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b7f85f55c64dbd8b4ff8ca1eeb0a0b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:59.674856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b7f85f55c64dbd8b4ff8ca1eeb0a0b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:59.675366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b7f85f55c64dbd8b4ff8ca1eeb0a0b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:59.781768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b7f85f55c64dbd8b4ff8ca1eeb0a0b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:59.811163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260084b-f82d-4e7a-94dd-c7233ac43151 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:59.811648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260084b-f82d-4e7a-94dd-c7233ac43151 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:59.811648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260084b-f82d-4e7a-94dd-c7233ac43151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:59.825968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1116/2261] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:59 2022] DELETE /identity/v3/users/28b7f85f55c64dbd8b4ff8ca1eeb0a0b => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:59.857459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-1260084b-f82d-4e7a-94dd-c7233ac43151 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:59.860189 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1260084b-f82d-4e7a-94dd-c7233ac43151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:00.048405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1146/2262] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:00.064256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:00.066021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:00.227568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f65aa-5f9f-484d-85f6-a0e2bea6fb79 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:00.233230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b6da9-0a7b-4415-b20d-7b24c6cb54c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:00.234003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b6da9-0a7b-4415-b20d-7b24c6cb54c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:00.234434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b6da9-0a7b-4415-b20d-7b24c6cb54c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:00.235040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b6da9-0a7b-4415-b20d-7b24c6cb54c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:00.255248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b6da9-0a7b-4415-b20d-7b24c6cb54c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:00.257733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b6da9-0a7b-4415-b20d-7b24c6cb54c9 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:00.271482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1117/2263] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:01.057437 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260084b-f82d-4e7a-94dd-c7233ac43151 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:01.068137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1260084b-f82d-4e7a-94dd-c7233ac43151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:01.129965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260084b-f82d-4e7a-94dd-c7233ac43151 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:01.153378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:01.154405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:01.154951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:01.155429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] PATH_INFO: `/v3/projects/bd3c870f4eb84f8f9eb237bee23e70ad` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:01.158223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3c870f4eb84f8f9eb237bee23e70ad)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:01.160916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:01.325059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3c870f4eb84f8f9eb237bee23e70ad', 'request_id': 'req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:01.340845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3c870f4eb84f8f9eb237bee23e70ad', 'request_id': 'req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:01.393802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:01.427563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3c870f4eb84f8f9eb237bee23e70ad', 'request_id': 'req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:01.444342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] The token cache is being invalidate because project bd3c870f4eb84f8f9eb237bee23e70ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:01.444987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:01.445884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:01.451414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1147/2264] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:01 2022] DELETE /identity/v3/projects/bd3c870f4eb84f8f9eb237bee23e70ad => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:01.456760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b6da9-0a7b-4415-b20d-7b24c6cb54c9 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:01.477175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b6da9-0a7b-4415-b20d-7b24c6cb54c9 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:01.602476 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:01.647616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:01.647616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:01.647616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:01.647616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] PATH_INFO: `/v3/users/4a8f50333041452089f178f8bcf2b7ce` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:01.647915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8f50333041452089f178f8bcf2b7ce)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:01.647915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:02.033446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8f50333041452089f178f8bcf2b7ce'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:02.035887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8f50333041452089f178f8bcf2b7ce'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:02.052925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8f50333041452089f178f8bcf2b7ce'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:02.054633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8f50333041452089f178f8bcf2b7ce'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:02.175056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-9a742e43-0251-4141-8f46-f3ad4cd3c99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8f50333041452089f178f8bcf2b7ce'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:02.209530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1118/2265] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:01 2022] DELETE /identity/v3/users/4a8f50333041452089f178f8bcf2b7ce => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:03.453781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:03.456139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:03.503781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de8d9a-a568-4cd5-84f9-b15738b0d9d1 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:03.612309 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:03.613781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:03.614351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:03.614965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] PATH_INFO: `/v3/projects/80059635594246cf96d7c5b2a2bd36fc` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:03.616512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=80059635594246cf96d7c5b2a2bd36fc)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:03.620037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:03.803266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80059635594246cf96d7c5b2a2bd36fc', 'request_id': 'req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:03.818299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80059635594246cf96d7c5b2a2bd36fc', 'request_id': 'req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:03.890725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80059635594246cf96d7c5b2a2bd36fc', 'request_id': 'req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:03.918048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] The token cache is being invalidate because project 80059635594246cf96d7c5b2a2bd36fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:03.921817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:03.927739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-041f6063-3e7c-4738-a4aa-7f6fcc9ae4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:03.934853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1148/2266] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:03 2022] DELETE /identity/v3/projects/80059635594246cf96d7c5b2a2bd36fc => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:03.939724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e18b2-dfee-49bf-b7f9-38313f29b1b3 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:03.940922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e18b2-dfee-49bf-b7f9-38313f29b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:03.941391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e18b2-dfee-49bf-b7f9-38313f29b1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:03.976714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-a56e18b2-dfee-49bf-b7f9-38313f29b1b3 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:03.982397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a56e18b2-dfee-49bf-b7f9-38313f29b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:04.018716 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:04.211787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1119/2267] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:04.218870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebccf1-8d96-40ab-9169-17f56fd4a8cc None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:04.220224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebccf1-8d96-40ab-9169-17f56fd4a8cc None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:04.220668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebccf1-8d96-40ab-9169-17f56fd4a8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:04.277734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-45ebccf1-8d96-40ab-9169-17f56fd4a8cc None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:04.279538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-45ebccf1-8d96-40ab-9169-17f56fd4a8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:04.300995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1149/2268] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:04.305213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e18b2-dfee-49bf-b7f9-38313f29b1b3 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:04.320798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e18b2-dfee-49bf-b7f9-38313f29b1b3 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:04.325765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:04.330266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c050a28-a0c6-476c-8005-7bb2bd3bc97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:04.334975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c050a28-a0c6-476c-8005-7bb2bd3bc97a admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:04.335265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c050a28-a0c6-476c-8005-7bb2bd3bc97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:04.335542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c050a28-a0c6-476c-8005-7bb2bd3bc97a admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:04.336537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c050a28-a0c6-476c-8005-7bb2bd3bc97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:27:04.336895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c050a28-a0c6-476c-8005-7bb2bd3bc97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:04.339261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c050a28-a0c6-476c-8005-7bb2bd3bc97a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:04.384693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1120/2269] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:27:04.389486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebccf1-8d96-40ab-9169-17f56fd4a8cc None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:04.410260 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebccf1-8d96-40ab-9169-17f56fd4a8cc None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:04.419006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac61a84-8da7-43ca-92b8-265fc9b0e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:04.419856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac61a84-8da7-43ca-92b8-265fc9b0e7bb admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:04.420206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac61a84-8da7-43ca-92b8-265fc9b0e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:04.420565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac61a84-8da7-43ca-92b8-265fc9b0e7bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:04.421799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac61a84-8da7-43ca-92b8-265fc9b0e7bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:04.426078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac61a84-8da7-43ca-92b8-265fc9b0e7bb admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:04.591416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1150/2270] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:04 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:27:04.596312 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c050a28-a0c6-476c-8005-7bb2bd3bc97a admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:04.610856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c050a28-a0c6-476c-8005-7bb2bd3bc97a admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:04.853883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cc3f6-a1dd-4c73-99b8-115309f74228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:04.855301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cc3f6-a1dd-4c73-99b8-115309f74228 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:04.856161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cc3f6-a1dd-4c73-99b8-115309f74228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:04.856624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cc3f6-a1dd-4c73-99b8-115309f74228 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:04.857825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cc3f6-a1dd-4c73-99b8-115309f74228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:04.860581 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cc3f6-a1dd-4c73-99b8-115309f74228 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.019734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1121/2271] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:27:04 2022] POST /identity/v3/users => generated 293 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:05.024043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac61a84-8da7-43ca-92b8-265fc9b0e7bb admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.049619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac61a84-8da7-43ca-92b8-265fc9b0e7bb admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.064627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d569b0d-86e7-44d8-9606-fdc291ab5bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.065898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d569b0d-86e7-44d8-9606-fdc291ab5bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.066506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d569b0d-86e7-44d8-9606-fdc291ab5bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.067042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d569b0d-86e7-44d8-9606-fdc291ab5bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.067902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d569b0d-86e7-44d8-9606-fdc291ab5bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.069823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d569b0d-86e7-44d8-9606-fdc291ab5bf0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.098561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1151/2272] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:05.101026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cc3f6-a1dd-4c73-99b8-115309f74228 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.142767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cc3f6-a1dd-4c73-99b8-115309f74228 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.182624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575440c-693c-403d-bffd-3ec5d97d4480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.183324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575440c-693c-403d-bffd-3ec5d97d4480 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.183605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575440c-693c-403d-bffd-3ec5d97d4480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.183881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575440c-693c-403d-bffd-3ec5d97d4480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.184598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575440c-693c-403d-bffd-3ec5d97d4480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.190647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575440c-693c-403d-bffd-3ec5d97d4480 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.235219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d569b0d-86e7-44d8-9606-fdc291ab5bf0 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.240320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1122/2273] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:05.255539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d569b0d-86e7-44d8-9606-fdc291ab5bf0 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.264014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca805-7665-4b5d-807b-d978f3741575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.266584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca805-7665-4b5d-807b-d978f3741575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.267353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca805-7665-4b5d-807b-d978f3741575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.271028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca805-7665-4b5d-807b-d978f3741575 admin admin] PATH_INFO: `/v3/projects/a31d9c39f1c244ae86062c0f27b27fe8/users/34cb7604763a471e989265047ef84ec6/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.314080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ca805-7665-4b5d-807b-d978f3741575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31d9c39f1c244ae86062c0f27b27fe8, user_id=34cb7604763a471e989265047ef84ec6, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.318065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ca805-7665-4b5d-807b-d978f3741575 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.424998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1152/2274] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:05 2022] PUT /identity/v3/projects/a31d9c39f1c244ae86062c0f27b27fe8/users/34cb7604763a471e989265047ef84ec6/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:05.430098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13559a-c35b-46bd-a372-ce034f53e0e0 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.430919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13559a-c35b-46bd-a372-ce034f53e0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.432346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13559a-c35b-46bd-a372-ce034f53e0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.496152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-0c13559a-c35b-46bd-a372-ce034f53e0e0 None None] MFA Rules not processed for user `34cb7604763a471e989265047ef84ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:05.501751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0c13559a-c35b-46bd-a372-ce034f53e0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:05.585609 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1123/2275] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:05.592543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca805-7665-4b5d-807b-d978f3741575 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.669873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca805-7665-4b5d-807b-d978f3741575 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.674974 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6efe7-568a-4976-ad12-fecf59025339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.675605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6efe7-568a-4976-ad12-fecf59025339 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.676003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6efe7-568a-4976-ad12-fecf59025339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.676172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6efe7-568a-4976-ad12-fecf59025339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.676809 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6efe7-568a-4976-ad12-fecf59025339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.679037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6efe7-568a-4976-ad12-fecf59025339 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.797410 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1153/2276] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:05 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:05.798619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13559a-c35b-46bd-a372-ce034f53e0e0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.811537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13559a-c35b-46bd-a372-ce034f53e0e0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.933999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ba249-5a4d-4579-8325-8e6dfebc161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.935944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ba249-5a4d-4579-8325-8e6dfebc161e admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.936891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ba249-5a4d-4579-8325-8e6dfebc161e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.937352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ba249-5a4d-4579-8325-8e6dfebc161e admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.938213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ba249-5a4d-4579-8325-8e6dfebc161e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.940803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ba249-5a4d-4579-8325-8e6dfebc161e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.035462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1124/2277] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:27:05 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:27:06.040222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6efe7-568a-4976-ad12-fecf59025339 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.060286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6efe7-568a-4976-ad12-fecf59025339 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.066477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345f1f4-2766-43ac-8e45-be0bef3d5e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.068149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345f1f4-2766-43ac-8e45-be0bef3d5e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.068860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345f1f4-2766-43ac-8e45-be0bef3d5e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.069695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345f1f4-2766-43ac-8e45-be0bef3d5e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.070695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345f1f4-2766-43ac-8e45-be0bef3d5e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.072636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345f1f4-2766-43ac-8e45-be0bef3d5e21 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.087963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1154/2278] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:06.091882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ba249-5a4d-4579-8325-8e6dfebc161e admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.106767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ba249-5a4d-4579-8325-8e6dfebc161e admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.118212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1589cf-0141-491a-8c63-38c2c9c9b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.120285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1589cf-0141-491a-8c63-38c2c9c9b717 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.121112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1589cf-0141-491a-8c63-38c2c9c9b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.122616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1589cf-0141-491a-8c63-38c2c9c9b717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.130151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1589cf-0141-491a-8c63-38c2c9c9b717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.131964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1589cf-0141-491a-8c63-38c2c9c9b717 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.146566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1125/2279] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:06.150728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345f1f4-2766-43ac-8e45-be0bef3d5e21 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.166755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:06.170699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345f1f4-2766-43ac-8e45-be0bef3d5e21 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.177918 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16860a35-dc77-44d8-b3a6-e991aa035657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.178536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16860a35-dc77-44d8-b3a6-e991aa035657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.179157 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16860a35-dc77-44d8-b3a6-e991aa035657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.179655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16860a35-dc77-44d8-b3a6-e991aa035657 admin admin] PATH_INFO: `/v3/projects/0f835c0d90cc4cefb543b52c3365a947/users/6e8571ea067d4575b2b8d1a1e13e574f/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.201470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16860a35-dc77-44d8-b3a6-e991aa035657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f835c0d90cc4cefb543b52c3365a947, user_id=6e8571ea067d4575b2b8d1a1e13e574f, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.219201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16860a35-dc77-44d8-b3a6-e991aa035657 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.267090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1589cf-0141-491a-8c63-38c2c9c9b717 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.268899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-bc1589cf-0141-491a-8c63-38c2c9c9b717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:06.285940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1589cf-0141-491a-8c63-38c2c9c9b717 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.304025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1155/2280] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:06 2022] PUT /identity/v3/projects/0f835c0d90cc4cefb543b52c3365a947/users/6e8571ea067d4575b2b8d1a1e13e574f/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:06.306043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c8bac-9e76-4a46-ac38-377b6012e6b7 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.306738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c8bac-9e76-4a46-ac38-377b6012e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.307130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c8bac-9e76-4a46-ac38-377b6012e6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.346297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-501c8bac-9e76-4a46-ac38-377b6012e6b7 None None] MFA Rules not processed for user `6e8571ea067d4575b2b8d1a1e13e574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:06.348725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-501c8bac-9e76-4a46-ac38-377b6012e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:06.445011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.446218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.447223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.447698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] PATH_INFO: `/v3/users/d75645499e0049039d8f8665f3d6f9af` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.456620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75645499e0049039d8f8665f3d6f9af)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.460893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.533047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1156/2281] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:06.540032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c8bac-9e76-4a46-ac38-377b6012e6b7 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.559875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c8bac-9e76-4a46-ac38-377b6012e6b7 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.566078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742f657-c086-4d5a-b3cb-5d3ec2d18718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.566832 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f657-c086-4d5a-b3cb-5d3ec2d18718 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.567159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f657-c086-4d5a-b3cb-5d3ec2d18718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.567441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f657-c086-4d5a-b3cb-5d3ec2d18718 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.568137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742f657-c086-4d5a-b3cb-5d3ec2d18718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.570712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742f657-c086-4d5a-b3cb-5d3ec2d18718 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.716494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1157/2282] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:06 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:06.724714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742f657-c086-4d5a-b3cb-5d3ec2d18718 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.784593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:06.802016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75645499e0049039d8f8665f3d6f9af'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:06.814376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75645499e0049039d8f8665f3d6f9af'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:06.825303 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75645499e0049039d8f8665f3d6f9af'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:06.828304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75645499e0049039d8f8665f3d6f9af'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:06.840123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742f657-c086-4d5a-b3cb-5d3ec2d18718 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.849612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc1630-7e50-410a-a72b-650dd6b60b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.858482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1630-7e50-410a-a72b-650dd6b60b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.858482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1630-7e50-410a-a72b-650dd6b60b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.858482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc1630-7e50-410a-a72b-650dd6b60b62 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.858482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc1630-7e50-410a-a72b-650dd6b60b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.858482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc1630-7e50-410a-a72b-650dd6b60b62 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.931493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6b91eebe-8f6f-45da-bd69-257d5f54814b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75645499e0049039d8f8665f3d6f9af'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:06.959504 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1126/2283] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:06 2022] DELETE /identity/v3/users/d75645499e0049039d8f8665f3d6f9af => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:06.965410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b9f4-f822-45d4-9d2d-7e750f45e41e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.965810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b9f4-f822-45d4-9d2d-7e750f45e41e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.966146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b9f4-f822-45d4-9d2d-7e750f45e41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:07.004018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1158/2284] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:27:06 2022] POST /identity/v3/users => generated 298 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:07.010488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc1630-7e50-410a-a72b-650dd6b60b62 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:07.013202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d3dc1630-7e50-410a-a72b-650dd6b60b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:07.021539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-4825b9f4-f822-45d4-9d2d-7e750f45e41e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:07.033856 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4825b9f4-f822-45d4-9d2d-7e750f45e41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:07.038428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc1630-7e50-410a-a72b-650dd6b60b62 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:07.172627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d74258-e620-42d4-919c-68a6dc8cb147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:07.173405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d74258-e620-42d4-919c-68a6dc8cb147 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:07.174387 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d74258-e620-42d4-919c-68a6dc8cb147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:07.175273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d74258-e620-42d4-919c-68a6dc8cb147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:07.177339 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d74258-e620-42d4-919c-68a6dc8cb147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:07.182577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d74258-e620-42d4-919c-68a6dc8cb147 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:07.187342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1127/2285] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:07.200539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b9f4-f822-45d4-9d2d-7e750f45e41e None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:07.205977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4825b9f4-f822-45d4-9d2d-7e750f45e41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:07.227566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1159/2286] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:07.227566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d74258-e620-42d4-919c-68a6dc8cb147 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:07.243847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d74258-e620-42d4-919c-68a6dc8cb147 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:07.249283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde1f7-7134-49d4-9927-dff66ff345c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:07.250865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde1f7-7134-49d4-9927-dff66ff345c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:07.250992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde1f7-7134-49d4-9927-dff66ff345c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:07.251380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde1f7-7134-49d4-9927-dff66ff345c5 admin admin] PATH_INFO: `/v3/projects/bb3bff7fcaf543239f0eeb51eda0f929/users/aec40950ae0747538be60541dfb26631/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:07.274479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fde1f7-7134-49d4-9927-dff66ff345c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3bff7fcaf543239f0eeb51eda0f929, user_id=aec40950ae0747538be60541dfb26631, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:07.278134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fde1f7-7134-49d4-9927-dff66ff345c5 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:07.322745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b9f4-f822-45d4-9d2d-7e750f45e41e None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:07.326391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117a09-5263-4e6a-8a0d-3749dde2af57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:07.327022 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117a09-5263-4e6a-8a0d-3749dde2af57 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:07.327295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117a09-5263-4e6a-8a0d-3749dde2af57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:07.327565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117a09-5263-4e6a-8a0d-3749dde2af57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:07.337184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27117a09-5263-4e6a-8a0d-3749dde2af57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:07.339208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27117a09-5263-4e6a-8a0d-3749dde2af57 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:07.349784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1128/2287] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:27:07.373342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1160/2288] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:07 2022] PUT /identity/v3/projects/bb3bff7fcaf543239f0eeb51eda0f929/users/aec40950ae0747538be60541dfb26631/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:07.377601 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117a09-5263-4e6a-8a0d-3749dde2af57 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:07.390738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117a09-5263-4e6a-8a0d-3749dde2af57 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:07.523248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6d219-d745-4bb5-875e-ad476a74f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:07.524189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6d219-d745-4bb5-875e-ad476a74f1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:07.524410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6d219-d745-4bb5-875e-ad476a74f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:07.527352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6d219-d745-4bb5-875e-ad476a74f1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:07.528443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6d219-d745-4bb5-875e-ad476a74f1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:07.531085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6d219-d745-4bb5-875e-ad476a74f1c3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:07.551161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1129/2289] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:07.555672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde1f7-7134-49d4-9927-dff66ff345c5 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:07.572578 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde1f7-7134-49d4-9927-dff66ff345c5 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:07.580376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d6b4a-10c8-4741-b8f7-15756285852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:07.581144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6b4a-10c8-4741-b8f7-15756285852c admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:07.581469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6b4a-10c8-4741-b8f7-15756285852c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:07.581813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6b4a-10c8-4741-b8f7-15756285852c admin admin] PATH_INFO: `/v3/projects/bb3bff7fcaf543239f0eeb51eda0f929/users/aec40950ae0747538be60541dfb26631/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:07.584112 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d6b4a-10c8-4741-b8f7-15756285852c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3bff7fcaf543239f0eeb51eda0f929, user_id=aec40950ae0747538be60541dfb26631, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:07.605104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d6b4a-10c8-4741-b8f7-15756285852c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:07.639477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1161/2290] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:07 2022] PUT /identity/v3/projects/bb3bff7fcaf543239f0eeb51eda0f929/users/aec40950ae0747538be60541dfb26631/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:07.658240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c3a7-1d04-45be-aadd-c2e8784e30d1 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:07.658626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c3a7-1d04-45be-aadd-c2e8784e30d1 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:07.659920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c3a7-1d04-45be-aadd-c2e8784e30d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:07.710954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d6b4a-10c8-4741-b8f7-15756285852c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:07.713970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-015d6b4a-10c8-4741-b8f7-15756285852c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:07.718507 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ce56c3a7-1d04-45be-aadd-c2e8784e30d1 None None] MFA Rules not processed for user `aec40950ae0747538be60541dfb26631`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:07.720690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ce56c3a7-1d04-45be-aadd-c2e8784e30d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:07.863408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1130/2291] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:07.866068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d6b4a-10c8-4741-b8f7-15756285852c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:07.877498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:07.879292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:07.885065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:07.885065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] PATH_INFO: `/v3/users/2786622da20840b69af845c9da9ecc3d` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:07.885907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56c3a7-1d04-45be-aadd-c2e8784e30d1 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:07.887993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ce56c3a7-1d04-45be-aadd-c2e8784e30d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:07.888122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2786622da20840b69af845c9da9ecc3d)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:07.890252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:08.025319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56c3a7-1d04-45be-aadd-c2e8784e30d1 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:08.034621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4493462-9868-47ff-9007-9f9f3c4f02a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:08.035525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493462-9868-47ff-9007-9f9f3c4f02a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:08.036022 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493462-9868-47ff-9007-9f9f3c4f02a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:08.039874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493462-9868-47ff-9007-9f9f3c4f02a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:08.039874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d4493462-9868-47ff-9007-9f9f3c4f02a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:08.152858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4493462-9868-47ff-9007-9f9f3c4f02a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:08.154843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4493462-9868-47ff-9007-9f9f3c4f02a7 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:08.180532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1131/2292] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:08.187103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2786622da20840b69af845c9da9ecc3d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.188603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2786622da20840b69af845c9da9ecc3d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.208129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2786622da20840b69af845c9da9ecc3d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.250127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2786622da20840b69af845c9da9ecc3d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.344255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2786622da20840b69af845c9da9ecc3d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.356818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1162/2293] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:07 2022] DELETE /identity/v3/users/2786622da20840b69af845c9da9ecc3d => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:08.361548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523507dd-d276-4ddd-bef8-3927882e9924 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:08.362111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523507dd-d276-4ddd-bef8-3927882e9924 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:08.362380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523507dd-d276-4ddd-bef8-3927882e9924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:08.389898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-523507dd-d276-4ddd-bef8-3927882e9924 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:08.392461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-523507dd-d276-4ddd-bef8-3927882e9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:08.467242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:08.469974 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:08.527397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1132/2294] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:08.539377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523507dd-d276-4ddd-bef8-3927882e9924 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:08.542442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-523507dd-d276-4ddd-bef8-3927882e9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:08.676852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023ca08-619a-4810-87a4-9e517028fc86 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:08.691630 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:08.702480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:08.703894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523507dd-d276-4ddd-bef8-3927882e9924 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:08.705214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:08.705602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] PATH_INFO: `/v3/projects/3c797fc807fe45bb9c38b9bc3d50bada` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:08.710976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c797fc807fe45bb9c38b9bc3d50bada)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:08.715492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dee71a-4950-48d3-a394-495842dfe9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:08.716613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dee71a-4950-48d3-a394-495842dfe9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:08.716838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dee71a-4950-48d3-a394-495842dfe9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:08.716998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dee71a-4950-48d3-a394-495842dfe9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:08.718523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:08.749806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dee71a-4950-48d3-a394-495842dfe9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:08.754439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dee71a-4950-48d3-a394-495842dfe9c0 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:08.782250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1133/2295] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:27:08.913640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:08.952412 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c797fc807fe45bb9c38b9bc3d50bada', 'request_id': 'req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.983502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c797fc807fe45bb9c38b9bc3d50bada', 'request_id': 'req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:09.154536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c797fc807fe45bb9c38b9bc3d50bada', 'request_id': 'req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:09.215822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] The token cache is being invalidate because project 3c797fc807fe45bb9c38b9bc3d50bada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:09.216118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:09.227585 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8d8c29ab-84ad-4f6c-9e5d-7f84a2c0c83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:09.258124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1163/2296] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:08 2022] DELETE /identity/v3/projects/3c797fc807fe45bb9c38b9bc3d50bada => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:09.262156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a1c62-7fd1-4a0e-b0c7-c6a3eca9016a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:09.266562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a1c62-7fd1-4a0e-b0c7-c6a3eca9016a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:09.266848 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a1c62-7fd1-4a0e-b0c7-c6a3eca9016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:09.347596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-484a1c62-7fd1-4a0e-b0c7-c6a3eca9016a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:09.349135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-484a1c62-7fd1-4a0e-b0c7-c6a3eca9016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:09.540075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1134/2297] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:09.544188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d5b6-c8df-4329-8792-356a9143cfac None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:09.544799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d5b6-c8df-4329-8792-356a9143cfac None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:09.545582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d5b6-c8df-4329-8792-356a9143cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:09.588241 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3327d5b6-c8df-4329-8792-356a9143cfac None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:09.589693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3327d5b6-c8df-4329-8792-356a9143cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:09.599926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1164/2298] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:09.606281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a1c62-7fd1-4a0e-b0c7-c6a3eca9016a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:09.623890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6262d2-2d6d-419c-84d8-0e8c976bec2c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:09.625612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6262d2-2d6d-419c-84d8-0e8c976bec2c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:09.626496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6262d2-2d6d-419c-84d8-0e8c976bec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:09.627396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a1c62-7fd1-4a0e-b0c7-c6a3eca9016a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:09.641855 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b3f9c-813a-4594-a378-5b3890c9ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:09.642864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3f9c-813a-4594-a378-5b3890c9ffce admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:09.643535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3f9c-813a-4594-a378-5b3890c9ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:09.644036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3f9c-813a-4594-a378-5b3890c9ffce admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:09.651552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b3f9c-813a-4594-a378-5b3890c9ffce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:27:09.652265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b3f9c-813a-4594-a378-5b3890c9ffce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:09.654812 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b3f9c-813a-4594-a378-5b3890c9ffce admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:09.682133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1135/2299] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:27:09.683240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b3f9c-813a-4594-a378-5b3890c9ffce admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:09.692215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-de6262d2-2d6d-419c-84d8-0e8c976bec2c None None] MFA Rules not processed for user `bbf747c57a314a9f9c3546ca5409d543`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:09.694371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-de6262d2-2d6d-419c-84d8-0e8c976bec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:09.696303 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b3f9c-813a-4594-a378-5b3890c9ffce admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:09.710158 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675638-7fe6-4136-ab5c-6ee28a7cb7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:09.710889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675638-7fe6-4136-ab5c-6ee28a7cb7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:09.711175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675638-7fe6-4136-ab5c-6ee28a7cb7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:09.711534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675638-7fe6-4136-ab5c-6ee28a7cb7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:09.712529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9675638-7fe6-4136-ab5c-6ee28a7cb7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:09.717287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9675638-7fe6-4136-ab5c-6ee28a7cb7f5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:09.818140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:09.845900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1165/2300] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:09.846588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1136/2301] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:09 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:09.865654 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675638-7fe6-4136-ab5c-6ee28a7cb7f5 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:09.868386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c9675638-7fe6-4136-ab5c-6ee28a7cb7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:09.877813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6262d2-2d6d-419c-84d8-0e8c976bec2c None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:09.904357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6262d2-2d6d-419c-84d8-0e8c976bec2c None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:10.025826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f8547-808a-4925-a8f5-eebe0c057d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:10.026619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675638-7fe6-4136-ab5c-6ee28a7cb7f5 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:10.029892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f8547-808a-4925-a8f5-eebe0c057d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.030276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f8547-808a-4925-a8f5-eebe0c057d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.030812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f8547-808a-4925-a8f5-eebe0c057d9e admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.031597 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f8547-808a-4925-a8f5-eebe0c057d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:10.033717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f8547-808a-4925-a8f5-eebe0c057d9e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:10.036438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58e11b-d5d3-44fb-8bf5-526f0bb88eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:10.037343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58e11b-d5d3-44fb-8bf5-526f0bb88eb3 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.037698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58e11b-d5d3-44fb-8bf5-526f0bb88eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.038043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58e11b-d5d3-44fb-8bf5-526f0bb88eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.040910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5c58e11b-d5d3-44fb-8bf5-526f0bb88eb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:10.131502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58e11b-d5d3-44fb-8bf5-526f0bb88eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:10.147189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58e11b-d5d3-44fb-8bf5-526f0bb88eb3 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:10.159077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1137/2302] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:10.177845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1166/2303] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:27:09 2022] POST /identity/v3/users => generated 286 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:10.184277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58e11b-d5d3-44fb-8bf5-526f0bb88eb3 service nova] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:10.200069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58e11b-d5d3-44fb-8bf5-526f0bb88eb3 service nova] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:10.207702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b30655-05b0-49f6-aaf2-abbbb372b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:10.208270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b30655-05b0-49f6-aaf2-abbbb372b409 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.208698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b30655-05b0-49f6-aaf2-abbbb372b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.209186 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b30655-05b0-49f6-aaf2-abbbb372b409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.209978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b30655-05b0-49f6-aaf2-abbbb372b409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:10.212668 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b30655-05b0-49f6-aaf2-abbbb372b409 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:10.233339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1138/2304] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:10.233491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f8547-808a-4925-a8f5-eebe0c057d9e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:10.244552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f8547-808a-4925-a8f5-eebe0c057d9e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:10.251982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8d500-5c06-4bd9-9c67-33bb813c7ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:10.252838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8d500-5c06-4bd9-9c67-33bb813c7ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.253503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8d500-5c06-4bd9-9c67-33bb813c7ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.253788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8d500-5c06-4bd9-9c67-33bb813c7ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.254621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8d500-5c06-4bd9-9c67-33bb813c7ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:10.256256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8d500-5c06-4bd9-9c67-33bb813c7ea4 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:10.273947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1167/2305] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:10.276049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b30655-05b0-49f6-aaf2-abbbb372b409 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:10.290341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b30655-05b0-49f6-aaf2-abbbb372b409 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:10.295548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0109792-b1d6-4436-a65c-9355c0181797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:10.296226 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109792-b1d6-4436-a65c-9355c0181797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.299426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109792-b1d6-4436-a65c-9355c0181797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.299426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0109792-b1d6-4436-a65c-9355c0181797 admin admin] PATH_INFO: `/v3/projects/ec163b07b5234a48ba80509ac693d8d3/users/02d384cc766b4ef8bc0498f8fe3e5566/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.314341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0109792-b1d6-4436-a65c-9355c0181797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec163b07b5234a48ba80509ac693d8d3, user_id=02d384cc766b4ef8bc0498f8fe3e5566, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:10.319952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0109792-b1d6-4436-a65c-9355c0181797 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:10.355191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8d500-5c06-4bd9-9c67-33bb813c7ea4 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:10.360774 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:10.362108 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4ac8d500-5c06-4bd9-9c67-33bb813c7ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:10.400778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8d500-5c06-4bd9-9c67-33bb813c7ea4 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:10.408816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:10.409860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.410199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.411225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] PATH_INFO: `/v3/projects/39d875691ee24b4585415418774f6cbc` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.413826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d875691ee24b4585415418774f6cbc)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:10.416684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:10.463595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1139/2306] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:10 2022] PUT /identity/v3/projects/ec163b07b5234a48ba80509ac693d8d3/users/02d384cc766b4ef8bc0498f8fe3e5566/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:10.468277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15b3d-293c-48bc-8c17-3df82c1604d4 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.468761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15b3d-293c-48bc-8c17-3df82c1604d4 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.470642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15b3d-293c-48bc-8c17-3df82c1604d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.499275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e9a15b3d-293c-48bc-8c17-3df82c1604d4 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:10.501202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e9a15b3d-293c-48bc-8c17-3df82c1604d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:10.590467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1140/2307] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:10.604860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a15b3d-293c-48bc-8c17-3df82c1604d4 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:10.604860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e9a15b3d-293c-48bc-8c17-3df82c1604d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:10.605116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d875691ee24b4585415418774f6cbc', 'request_id': 'req-812229a5-4d02-4770-8444-424841e996c2'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:10.613372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d875691ee24b4585415418774f6cbc', 'request_id': 'req-812229a5-4d02-4770-8444-424841e996c2'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:10.705213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a15b3d-293c-48bc-8c17-3df82c1604d4 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:10.749289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d875691ee24b4585415418774f6cbc', 'request_id': 'req-812229a5-4d02-4770-8444-424841e996c2'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:10.765132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] The token cache is being invalidate because project 39d875691ee24b4585415418774f6cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:10.766242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:10.769693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:10.782366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1168/2308] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:10 2022] DELETE /identity/v3/projects/39d875691ee24b4585415418774f6cbc => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:27:10.782366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:10.782685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28e742-0752-4c92-937e-80b50589b2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:10.782685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28e742-0752-4c92-937e-80b50589b2fb service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.782685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28e742-0752-4c92-937e-80b50589b2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.782685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28e742-0752-4c92-937e-80b50589b2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.788551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:10.798842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2d28e742-0752-4c92-937e-80b50589b2fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:10.916479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812229a5-4d02-4770-8444-424841e996c2 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:10.929075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1c486-40e4-4c2d-8593-8a2a27a2dc3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:10.933289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1c486-40e4-4c2d-8593-8a2a27a2dc3b service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.934345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1c486-40e4-4c2d-8593-8a2a27a2dc3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.935175 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1c486-40e4-4c2d-8593-8a2a27a2dc3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.949442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b7d1c486-40e4-4c2d-8593-8a2a27a2dc3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:10.968844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28e742-0752-4c92-937e-80b50589b2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:10.971026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28e742-0752-4c92-937e-80b50589b2fb service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:11.011804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1141/2309] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:11.210476 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1c486-40e4-4c2d-8593-8a2a27a2dc3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:11.213467 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1c486-40e4-4c2d-8593-8a2a27a2dc3b service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:11.244917 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1169/2310] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:13.429679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28e742-0752-4c92-937e-80b50589b2fb service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:13.431870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2d28e742-0752-4c92-937e-80b50589b2fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:13.450561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28e742-0752-4c92-937e-80b50589b2fb service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:13.455559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b013f1-6055-4f11-bda0-40a30bba9373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:13.456528 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b013f1-6055-4f11-bda0-40a30bba9373 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.457053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b013f1-6055-4f11-bda0-40a30bba9373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.458652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b013f1-6055-4f11-bda0-40a30bba9373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.461112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-51b013f1-6055-4f11-bda0-40a30bba9373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:13.607742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b013f1-6055-4f11-bda0-40a30bba9373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:13.609843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b013f1-6055-4f11-bda0-40a30bba9373 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:13.644808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1142/2311] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:13.721899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b421-7007-404a-9fc7-ca834a5f6abf None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.722489 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b421-7007-404a-9fc7-ca834a5f6abf None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.722877 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b421-7007-404a-9fc7-ca834a5f6abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.781316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-15c1b421-7007-404a-9fc7-ca834a5f6abf None None] MFA Rules not processed for user `02d384cc766b4ef8bc0498f8fe3e5566`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:13.782589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-15c1b421-7007-404a-9fc7-ca834a5f6abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:13.914125 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:13.916938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1170/2312] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:13.938040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b013f1-6055-4f11-bda0-40a30bba9373 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:13.955030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b013f1-6055-4f11-bda0-40a30bba9373 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:13.960050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967e482-1d72-46cb-a77e-c46defbce21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:13.960880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e482-1d72-46cb-a77e-c46defbce21b service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.961165 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e482-1d72-46cb-a77e-c46defbce21b service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.961443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e482-1d72-46cb-a77e-c46defbce21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.988442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967e482-1d72-46cb-a77e-c46defbce21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:13.990497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967e482-1d72-46cb-a77e-c46defbce21b service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:14.002593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1143/2313] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:14.477689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:14.637194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da7031-c136-4178-a8d3-7f908f3b3e3e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:14.637468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da7031-c136-4178-a8d3-7f908f3b3e3e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:14.637737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da7031-c136-4178-a8d3-7f908f3b3e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:14.658900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-96da7031-c136-4178-a8d3-7f908f3b3e3e None None] MFA Rules not processed for user `9cb49b631c234f9a9fd47049b9b2e097`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:14.660156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-96da7031-c136-4178-a8d3-7f908f3b3e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:14.730782 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1171/2314] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:14.884700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32cefb-35a8-40a8-9313-3ea7ae8b358a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:14.885177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32cefb-35a8-40a8-9313-3ea7ae8b358a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:14.885620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32cefb-35a8-40a8-9313-3ea7ae8b358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:14.923816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-fb32cefb-35a8-40a8-9313-3ea7ae8b358a None None] MFA Rules not processed for user `965cf2aad5bc4def9fca55aac87cc37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:14.925455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-fb32cefb-35a8-40a8-9313-3ea7ae8b358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:15.042733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1144/2315] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:15.991969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e431-4f75-41e4-bdda-efae9fd8e1ce None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:15.992457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e431-4f75-41e4-bdda-efae9fd8e1ce None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:15.992538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e431-4f75-41e4-bdda-efae9fd8e1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:16.016169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0732e431-4f75-41e4-bdda-efae9fd8e1ce None None] MFA Rules not processed for user `02d384cc766b4ef8bc0498f8fe3e5566`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:16.017354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0732e431-4f75-41e4-bdda-efae9fd8e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:16.034001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1172/2316] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:16.685153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:17.285772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:19.028667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32cefb-35a8-40a8-9313-3ea7ae8b358a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:19.030878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-fb32cefb-35a8-40a8-9313-3ea7ae8b358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:19.056423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32cefb-35a8-40a8-9313-3ea7ae8b358a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:19.062424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:19.063367 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.063814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.064298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] PATH_INFO: `/v3/users/00ff08bdc73a4f0b940a54d449f6b92d` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.065876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ff08bdc73a4f0b940a54d449f6b92d)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:19.069016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:19.197979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e431-4f75-41e4-bdda-efae9fd8e1ce None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:19.200112 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0732e431-4f75-41e4-bdda-efae9fd8e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:19.218229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e431-4f75-41e4-bdda-efae9fd8e1ce None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:19.224490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:19.225273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.225475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.225748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] PATH_INFO: `/v3/users/34cb7604763a471e989265047ef84ec6` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.236271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cb7604763a471e989265047ef84ec6)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:19.236749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:19.439359 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ff08bdc73a4f0b940a54d449f6b92d'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:19.440354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ff08bdc73a4f0b940a54d449f6b92d'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:19.474634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ff08bdc73a4f0b940a54d449f6b92d'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:19.474634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ff08bdc73a4f0b940a54d449f6b92d'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:19.605317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d437e008-916c-48b8-819c-5a19f5b18709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ff08bdc73a4f0b940a54d449f6b92d'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:19.627126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cb7604763a471e989265047ef84ec6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:19.628119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cb7604763a471e989265047ef84ec6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:19.628780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1145/2317] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:19 2022] DELETE /identity/v3/users/00ff08bdc73a4f0b940a54d449f6b92d => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:19.633150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cea79f-24fa-4211-93f3-495277edb67b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.633446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cea79f-24fa-4211-93f3-495277edb67b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.633775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cea79f-24fa-4211-93f3-495277edb67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.637783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cb7604763a471e989265047ef84ec6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:19.652573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cb7604763a471e989265047ef84ec6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:19.659423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-71cea79f-24fa-4211-93f3-495277edb67b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:19.660647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-71cea79f-24fa-4211-93f3-495277edb67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:19.758384 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1146/2318] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:19.764504 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f9504e65-2c42-448c-b815-0601d10508c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cb7604763a471e989265047ef84ec6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:19.769916 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cea79f-24fa-4211-93f3-495277edb67b None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:19.771330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-71cea79f-24fa-4211-93f3-495277edb67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:19.772119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1173/2319] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:19 2022] DELETE /identity/v3/users/34cb7604763a471e989265047ef84ec6 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:19.780457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc8db0-42a7-4233-8a03-cea90e71178f None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.781110 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc8db0-42a7-4233-8a03-cea90e71178f None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.781714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc8db0-42a7-4233-8a03-cea90e71178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.824598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a0bc8db0-42a7-4233-8a03-cea90e71178f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:19.824598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a0bc8db0-42a7-4233-8a03-cea90e71178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:19.856914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cea79f-24fa-4211-93f3-495277edb67b None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:19.926244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:19.932844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1174/2320] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:19.942493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc8db0-42a7-4233-8a03-cea90e71178f None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:19.944075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31105be7-9eac-4ec2-82eb-c5430089b212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:19.944277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31105be7-9eac-4ec2-82eb-c5430089b212 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.944689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31105be7-9eac-4ec2-82eb-c5430089b212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.945132 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31105be7-9eac-4ec2-82eb-c5430089b212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.965846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc8db0-42a7-4233-8a03-cea90e71178f None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:19.968923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31105be7-9eac-4ec2-82eb-c5430089b212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:19.970460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31105be7-9eac-4ec2-82eb-c5430089b212 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:19.983194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9103fe3-edcd-442a-baf1-db300e818d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:19.983748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1147/2321] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:19.984193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9103fe3-edcd-442a-baf1-db300e818d60 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.984695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9103fe3-edcd-442a-baf1-db300e818d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.985044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9103fe3-edcd-442a-baf1-db300e818d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.998256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9103fe3-edcd-442a-baf1-db300e818d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:20.000048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9103fe3-edcd-442a-baf1-db300e818d60 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:20.014719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1175/2322] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:27:20.327048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:20.811172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31105be7-9eac-4ec2-82eb-c5430089b212 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:20.813410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-31105be7-9eac-4ec2-82eb-c5430089b212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:20.851692 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31105be7-9eac-4ec2-82eb-c5430089b212 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:20.881985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:20.882925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:20.883198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:20.884189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] PATH_INFO: `/v3/projects/a2707c13a13d48c0b0f2ca16cd9946a3` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:20.890681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2707c13a13d48c0b0f2ca16cd9946a3)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:20.893279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:20.953081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9103fe3-edcd-442a-baf1-db300e818d60 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:20.959686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d9103fe3-edcd-442a-baf1-db300e818d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:20.994963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9103fe3-edcd-442a-baf1-db300e818d60 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:21.004174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:21.004834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:21.005104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:21.005569 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] PATH_INFO: `/v3/projects/a31d9c39f1c244ae86062c0f27b27fe8` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:21.007429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31d9c39f1c244ae86062c0f27b27fe8)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:21.009958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:21.131178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2707c13a13d48c0b0f2ca16cd9946a3', 'request_id': 'req-c71d0cde-03ab-4221-babf-9761dceb1423'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:21.141768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2707c13a13d48c0b0f2ca16cd9946a3', 'request_id': 'req-c71d0cde-03ab-4221-babf-9761dceb1423'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:21.312103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2707c13a13d48c0b0f2ca16cd9946a3', 'request_id': 'req-c71d0cde-03ab-4221-babf-9761dceb1423'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:21.340123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] The token cache is being invalidate because project a2707c13a13d48c0b0f2ca16cd9946a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:21.340710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:21.341464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:21.344959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1148/2323] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:20 2022] DELETE /identity/v3/projects/a2707c13a13d48c0b0f2ca16cd9946a3 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:21.351100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31d9c39f1c244ae86062c0f27b27fe8', 'request_id': 'req-17cdea2c-5a9a-48f2-8343-39ddae5bc607'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:21.379659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31d9c39f1c244ae86062c0f27b27fe8', 'request_id': 'req-17cdea2c-5a9a-48f2-8343-39ddae5bc607'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:21.474835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31d9c39f1c244ae86062c0f27b27fe8', 'request_id': 'req-17cdea2c-5a9a-48f2-8343-39ddae5bc607'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:21.494616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] The token cache is being invalidate because project a31d9c39f1c244ae86062c0f27b27fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:21.496287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:21.497611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:21.501168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1176/2324] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:20 2022] DELETE /identity/v3/projects/a31d9c39f1c244ae86062c0f27b27fe8 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:21.510385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:21.510385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:21.616574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d0cde-03ab-4221-babf-9761dceb1423 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:21.791446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:21.796489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:21.796489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:21.796489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] PATH_INFO: `/v3/users/6e8571ea067d4575b2b8d1a1e13e574f` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:21.796953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8571ea067d4575b2b8d1a1e13e574f)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:21.802038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:21.988390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:22.134195 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8571ea067d4575b2b8d1a1e13e574f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:22.135066 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8571ea067d4575b2b8d1a1e13e574f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:22.151967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8571ea067d4575b2b8d1a1e13e574f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:22.152817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8571ea067d4575b2b8d1a1e13e574f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:22.382122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8571ea067d4575b2b8d1a1e13e574f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:22.412100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1149/2325] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:21 2022] DELETE /identity/v3/users/6e8571ea067d4575b2b8d1a1e13e574f => generated 0 bytes in 908 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:23.203525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:23.205416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:23.220378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdea2c-5a9a-48f2-8343-39ddae5bc607 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:23.317571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:23.318758 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:23.319216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:23.319658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] PATH_INFO: `/v3/projects/0f835c0d90cc4cefb543b52c3365a947` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:23.323461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f835c0d90cc4cefb543b52c3365a947)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:23.325155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:23.489389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f835c0d90cc4cefb543b52c3365a947', 'request_id': 'req-c1773af5-c436-45cb-b96e-96e5ed0ec29e'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:23.493003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:23.500262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f835c0d90cc4cefb543b52c3365a947', 'request_id': 'req-c1773af5-c436-45cb-b96e-96e5ed0ec29e'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:23.588327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f835c0d90cc4cefb543b52c3365a947', 'request_id': 'req-c1773af5-c436-45cb-b96e-96e5ed0ec29e'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:23.616839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] The token cache is being invalidate because project 0f835c0d90cc4cefb543b52c3365a947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:23.617478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:23.618694 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:23.624317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1177/2326] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:23 2022] DELETE /identity/v3/projects/0f835c0d90cc4cefb543b52c3365a947 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:23.627949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:23.629793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:23.653114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e5916-a0c3-442f-bdfa-561d70598921 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:23.727201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:23.729120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:23.729640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:23.730054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] PATH_INFO: `/v3/users/aec40950ae0747538be60541dfb26631` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:23.732974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec40950ae0747538be60541dfb26631)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:23.735819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:23.990164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec40950ae0747538be60541dfb26631'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:23.997962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec40950ae0747538be60541dfb26631'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:24.003019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec40950ae0747538be60541dfb26631'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:24.004531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec40950ae0747538be60541dfb26631'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:24.125057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c12e798e-a45a-40d9-a8db-9d80c3357541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec40950ae0747538be60541dfb26631'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:24.151667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1150/2327] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:23 2022] DELETE /identity/v3/users/aec40950ae0747538be60541dfb26631 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:24.221945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:24.701900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:24.703413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:24.717245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1773af5-c436-45cb-b96e-96e5ed0ec29e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:24.793045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:24.793734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:24.793999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:24.794274 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] PATH_INFO: `/v3/projects/bb3bff7fcaf543239f0eeb51eda0f929` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:24.795713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3bff7fcaf543239f0eeb51eda0f929)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:24.799465 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:24.923081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3bff7fcaf543239f0eeb51eda0f929', 'request_id': 'req-f65d7f68-232b-4630-91f9-610a7ce6f676'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:24.929293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3bff7fcaf543239f0eeb51eda0f929', 'request_id': 'req-f65d7f68-232b-4630-91f9-610a7ce6f676'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:25.112422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3bff7fcaf543239f0eeb51eda0f929', 'request_id': 'req-f65d7f68-232b-4630-91f9-610a7ce6f676'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:25.125015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] The token cache is being invalidate because project bb3bff7fcaf543239f0eeb51eda0f929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:25.125303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:25.125984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-f65d7f68-232b-4630-91f9-610a7ce6f676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:25.127649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1178/2328] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:24 2022] DELETE /identity/v3/projects/bb3bff7fcaf543239f0eeb51eda0f929 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:25.135431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30285d85-3d20-4e9a-a30d-22c8dede88c2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:25.136537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30285d85-3d20-4e9a-a30d-22c8dede88c2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:25.136824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30285d85-3d20-4e9a-a30d-22c8dede88c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:25.160627 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-30285d85-3d20-4e9a-a30d-22c8dede88c2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:25.162331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-30285d85-3d20-4e9a-a30d-22c8dede88c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:25.241626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1151/2329] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:25.250648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ae3f9-821c-4b59-859c-c0bd9071dc13 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:25.251086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ae3f9-821c-4b59-859c-c0bd9071dc13 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:25.251423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ae3f9-821c-4b59-859c-c0bd9071dc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:25.278428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-848ae3f9-821c-4b59-859c-c0bd9071dc13 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:25.279659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-848ae3f9-821c-4b59-859c-c0bd9071dc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:25.288615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1179/2330] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:25.293658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30285d85-3d20-4e9a-a30d-22c8dede88c2 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:25.303757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30285d85-3d20-4e9a-a30d-22c8dede88c2 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:25.310072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5dc34-daa7-4811-92fc-500a2706989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:25.311117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5dc34-daa7-4811-92fc-500a2706989d admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:25.311285 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5dc34-daa7-4811-92fc-500a2706989d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:25.311582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5dc34-daa7-4811-92fc-500a2706989d admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:25.312370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5dc34-daa7-4811-92fc-500a2706989d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:27:25.312740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5dc34-daa7-4811-92fc-500a2706989d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:25.314793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5dc34-daa7-4811-92fc-500a2706989d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:25.343187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1152/2331] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:27:25.344440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ae3f9-821c-4b59-859c-c0bd9071dc13 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:25.355240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ae3f9-821c-4b59-859c-c0bd9071dc13 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:25.360101 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9b89b-85d2-49af-b4ee-e0c3c4bb6eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:25.360775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9b89b-85d2-49af-b4ee-e0c3c4bb6eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:25.361049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9b89b-85d2-49af-b4ee-e0c3c4bb6eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:25.364106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9b89b-85d2-49af-b4ee-e0c3c4bb6eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:25.364106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9b89b-85d2-49af-b4ee-e0c3c4bb6eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:25.364581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9b89b-85d2-49af-b4ee-e0c3c4bb6eb1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:25.401909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:25.404514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd234ff-4409-44da-883d-7aa6d6c56b77 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:25.405052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd234ff-4409-44da-883d-7aa6d6c56b77 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:25.405345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd234ff-4409-44da-883d-7aa6d6c56b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:25.427515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-cfd234ff-4409-44da-883d-7aa6d6c56b77 None None] MFA Rules not processed for user `ab8f887f5689419e9e31a0ba43f76ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:25.428861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cfd234ff-4409-44da-883d-7aa6d6c56b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:25.498109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1153/2332] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:25.499186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1180/2333] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:25 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:25.503402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd234ff-4409-44da-883d-7aa6d6c56b77 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:25.515679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd234ff-4409-44da-883d-7aa6d6c56b77 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:25.582138 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1b068-42f9-465c-afd0-5bd69d0eec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:25.582787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1b068-42f9-465c-afd0-5bd69d0eec73 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:25.583067 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1b068-42f9-465c-afd0-5bd69d0eec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:25.583499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1b068-42f9-465c-afd0-5bd69d0eec73 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:25.584209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1b068-42f9-465c-afd0-5bd69d0eec73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:25.586136 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1b068-42f9-465c-afd0-5bd69d0eec73 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:25.709327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1154/2334] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:27:25 2022] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:25.715052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9b89b-85d2-49af-b4ee-e0c3c4bb6eb1 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:25.726401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9b89b-85d2-49af-b4ee-e0c3c4bb6eb1 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:25.732963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5bab6-d551-4cc3-b158-361a8be62821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:25.733765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5bab6-d551-4cc3-b158-361a8be62821 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:25.734040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5bab6-d551-4cc3-b158-361a8be62821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:25.734338 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5bab6-d551-4cc3-b158-361a8be62821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:25.736266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5bab6-d551-4cc3-b158-361a8be62821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:25.737921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5bab6-d551-4cc3-b158-361a8be62821 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:25.755676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1181/2335] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:27:25.756797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1b068-42f9-465c-afd0-5bd69d0eec73 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:25.769348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1b068-42f9-465c-afd0-5bd69d0eec73 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:25.774807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a2797-c75c-4e85-84ec-09cc9bf524af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:25.775524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a2797-c75c-4e85-84ec-09cc9bf524af admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:25.775875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a2797-c75c-4e85-84ec-09cc9bf524af admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:25.776214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a2797-c75c-4e85-84ec-09cc9bf524af admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:25.777000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a2797-c75c-4e85-84ec-09cc9bf524af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:25.778718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a2797-c75c-4e85-84ec-09cc9bf524af admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:25.790539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1155/2336] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:25.796791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5bab6-d551-4cc3-b158-361a8be62821 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:25.809877 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5bab6-d551-4cc3-b158-361a8be62821 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:25.815241 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7de55-2049-44ce-9a7d-cf9a52de4d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:25.816017 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7de55-2049-44ce-9a7d-cf9a52de4d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:25.816356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7de55-2049-44ce-9a7d-cf9a52de4d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:25.816631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7de55-2049-44ce-9a7d-cf9a52de4d88 admin admin] PATH_INFO: `/v3/projects/450d26d272894014b89d3c8d6031a4ac/users/778d72ec5d1e4ac5aec519e89414b0fb/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:25.835370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7de55-2049-44ce-9a7d-cf9a52de4d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=450d26d272894014b89d3c8d6031a4ac, user_id=778d72ec5d1e4ac5aec519e89414b0fb, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:25.839169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7de55-2049-44ce-9a7d-cf9a52de4d88 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:25.902008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1182/2337] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:25 2022] PUT /identity/v3/projects/450d26d272894014b89d3c8d6031a4ac/users/778d72ec5d1e4ac5aec519e89414b0fb/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:25.913453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82c81-6976-452a-8ed5-b43740f0f59a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:25.915205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82c81-6976-452a-8ed5-b43740f0f59a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:25.915205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82c81-6976-452a-8ed5-b43740f0f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:25.963352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9cc82c81-6976-452a-8ed5-b43740f0f59a None None] MFA Rules not processed for user `778d72ec5d1e4ac5aec519e89414b0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:25.964842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9cc82c81-6976-452a-8ed5-b43740f0f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:26.062095 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1156/2338] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:26.074131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7de55-2049-44ce-9a7d-cf9a52de4d88 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:26.076234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bec7de55-2049-44ce-9a7d-cf9a52de4d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:26.153207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7de55-2049-44ce-9a7d-cf9a52de4d88 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:26.157429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfcc81-6ef5-4f47-a975-27284117fcce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc9a884f16149cda246ea9638621296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:26.159505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfcc81-6ef5-4f47-a975-27284117fcce service glance] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:26.160047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfcc81-6ef5-4f47-a975-27284117fcce service glance] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:26.160562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfcc81-6ef5-4f47-a975-27284117fcce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:26.174890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:26.178161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfcc81-6ef5-4f47-a975-27284117fcce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:26.179551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfcc81-6ef5-4f47-a975-27284117fcce service glance] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:26.192691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1183/2339] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:27:27.078870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:27.850106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:29.701392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:29.929530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:31.312943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:32.335766 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:32.524770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:33.497235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:33.855601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:34.278956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:34.416078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:35.376013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:35.627599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:35.666835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:36.056791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:37.106924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:37.245204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:37.805184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:38.169861 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:39.110060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:39.632512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:40.329377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:40.455803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:41.067301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:41.364662 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:42.073097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:42.627047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:45.064591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11298d04-88d5-449a-ba1f-4b4da7cb9346 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:45.064591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11298d04-88d5-449a-ba1f-4b4da7cb9346 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:45.064591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11298d04-88d5-449a-ba1f-4b4da7cb9346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:45.088170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-11298d04-88d5-449a-ba1f-4b4da7cb9346 None None] MFA Rules not processed for user `02d384cc766b4ef8bc0498f8fe3e5566`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:45.089669 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-11298d04-88d5-449a-ba1f-4b4da7cb9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:45.138828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:45.150829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1157/2340] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:27:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:52.986706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:55.244821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:03.759357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfcc81-6ef5-4f47-a975-27284117fcce service glance] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:03.761169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8ecfcc81-6ef5-4f47-a975-27284117fcce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:03.818198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfcc81-6ef5-4f47-a975-27284117fcce service glance] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:03.822593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ca0eb-5f3b-48ee-ac5c-828c759b7ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:03.823207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ca0eb-5f3b-48ee-ac5c-828c759b7ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:03.823490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ca0eb-5f3b-48ee-ac5c-828c759b7ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:03.823764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ca0eb-5f3b-48ee-ac5c-828c759b7ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:03.825520 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-909ca0eb-5f3b-48ee-ac5c-828c759b7ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:03.898923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ca0eb-5f3b-48ee-ac5c-828c759b7ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:03.900940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ca0eb-5f3b-48ee-ac5c-828c759b7ce2 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:03.914010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1184/2341] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:07.759158 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11298d04-88d5-449a-ba1f-4b4da7cb9346 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:07.827865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11298d04-88d5-449a-ba1f-4b4da7cb9346 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:07.832390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:07.833031 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:07.833308 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:07.833581 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] PATH_INFO: `/v3/users/778d72ec5d1e4ac5aec519e89414b0fb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:07.834775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=778d72ec5d1e4ac5aec519e89414b0fb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:07.837381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:08.022556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778d72ec5d1e4ac5aec519e89414b0fb'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:08.023154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778d72ec5d1e4ac5aec519e89414b0fb'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:08.030983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778d72ec5d1e4ac5aec519e89414b0fb'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:08.031647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778d72ec5d1e4ac5aec519e89414b0fb'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:08.111795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778d72ec5d1e4ac5aec519e89414b0fb'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:08.132476 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1158/2342] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:28:07 2022] DELETE /identity/v3/users/778d72ec5d1e4ac5aec519e89414b0fb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:08.137986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be849f-280a-4aeb-b64a-a44255e2f7a2 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:08.138606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be849f-280a-4aeb-b64a-a44255e2f7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:08.138816 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be849f-280a-4aeb-b64a-a44255e2f7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:08.160733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-59be849f-280a-4aeb-b64a-a44255e2f7a2 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:08.162049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-59be849f-280a-4aeb-b64a-a44255e2f7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:08.228449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1185/2343] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:08.237787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:08.241558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:08.304020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8ff34-e37c-418d-ba3d-822895d50972 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:08.308451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255124b9-cc8e-4526-8c39-2ad700828f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:08.309080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255124b9-cc8e-4526-8c39-2ad700828f0d service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:08.309359 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255124b9-cc8e-4526-8c39-2ad700828f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:08.309667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255124b9-cc8e-4526-8c39-2ad700828f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:08.319621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255124b9-cc8e-4526-8c39-2ad700828f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:08.322357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255124b9-cc8e-4526-8c39-2ad700828f0d service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:08.332424 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1159/2344] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:08.776697 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be849f-280a-4aeb-b64a-a44255e2f7a2 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:08.778195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-59be849f-280a-4aeb-b64a-a44255e2f7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:08.792046 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be849f-280a-4aeb-b64a-a44255e2f7a2 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:08.797517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:08.798164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:08.798475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:08.810458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] PATH_INFO: `/v3/projects/450d26d272894014b89d3c8d6031a4ac` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:08.810458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] RBAC: Authorizing `identity:delete_project(project_id=450d26d272894014b89d3c8d6031a4ac)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:08.810458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:08.972670 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:08.975508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450d26d272894014b89d3c8d6031a4ac', 'request_id': 'req-4e51ef64-cb33-4379-8517-0f2e5a30599d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:08.981886 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450d26d272894014b89d3c8d6031a4ac', 'request_id': 'req-4e51ef64-cb33-4379-8517-0f2e5a30599d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:09.145992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450d26d272894014b89d3c8d6031a4ac', 'request_id': 'req-4e51ef64-cb33-4379-8517-0f2e5a30599d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:09.157064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] The token cache is being invalidate because project 450d26d272894014b89d3c8d6031a4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:28:09.157350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:09.158381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4e51ef64-cb33-4379-8517-0f2e5a30599d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:09.160013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1186/2345] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:28:08 2022] DELETE /identity/v3/projects/450d26d272894014b89d3c8d6031a4ac => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:09.165861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c38e94-8017-48ec-a921-e378741a2205 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:09.171663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c38e94-8017-48ec-a921-e378741a2205 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:09.171663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c38e94-8017-48ec-a921-e378741a2205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:09.188234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-56c38e94-8017-48ec-a921-e378741a2205 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:09.189446 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-56c38e94-8017-48ec-a921-e378741a2205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:09.207243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:09.249261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1160/2346] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:09.257428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bdc65-6fe8-4038-88cc-fa7ed4644c95 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:09.257707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bdc65-6fe8-4038-88cc-fa7ed4644c95 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:09.257979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bdc65-6fe8-4038-88cc-fa7ed4644c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:09.279929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f84bdc65-6fe8-4038-88cc-fa7ed4644c95 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:09.281153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f84bdc65-6fe8-4038-88cc-fa7ed4644c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:09.289363 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1187/2347] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:09.293785 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c38e94-8017-48ec-a921-e378741a2205 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:09.303588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c38e94-8017-48ec-a921-e378741a2205 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:09.308189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b7d0-5131-40e5-9a7f-7b21a66d3267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:09.308798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b7d0-5131-40e5-9a7f-7b21a66d3267 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:09.309073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b7d0-5131-40e5-9a7f-7b21a66d3267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:09.309346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b7d0-5131-40e5-9a7f-7b21a66d3267 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:09.310093 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685b7d0-5131-40e5-9a7f-7b21a66d3267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:28:09.310642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685b7d0-5131-40e5-9a7f-7b21a66d3267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:09.312498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685b7d0-5131-40e5-9a7f-7b21a66d3267 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:09.325122 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1161/2348] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:28:09.329514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bdc65-6fe8-4038-88cc-fa7ed4644c95 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:09.340105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bdc65-6fe8-4038-88cc-fa7ed4644c95 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:09.344934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88f3b-18ce-4251-b398-9b729b93a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:09.345526 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88f3b-18ce-4251-b398-9b729b93a0bf admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:09.345800 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88f3b-18ce-4251-b398-9b729b93a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:09.346068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88f3b-18ce-4251-b398-9b729b93a0bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:09.346767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f88f3b-18ce-4251-b398-9b729b93a0bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:09.348682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f88f3b-18ce-4251-b398-9b729b93a0bf admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:09.450915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1188/2349] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:28:09 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:28:09.455458 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b7d0-5131-40e5-9a7f-7b21a66d3267 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:09.467247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b7d0-5131-40e5-9a7f-7b21a66d3267 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:09.528029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1852ca-09fe-45d1-b691-750c409e46ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:09.528239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1852ca-09fe-45d1-b691-750c409e46ee admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:09.528443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1852ca-09fe-45d1-b691-750c409e46ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:09.528704 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1852ca-09fe-45d1-b691-750c409e46ee admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:09.529370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1852ca-09fe-45d1-b691-750c409e46ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:09.531311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1852ca-09fe-45d1-b691-750c409e46ee admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:09.637683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1162/2350] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:28:09 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:28:09.642029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88f3b-18ce-4251-b398-9b729b93a0bf admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:09.653813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88f3b-18ce-4251-b398-9b729b93a0bf admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:09.658985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928c54-6510-462c-b8aa-b08831dd620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:09.659581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928c54-6510-462c-b8aa-b08831dd620e admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:09.659853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928c54-6510-462c-b8aa-b08831dd620e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:09.660122 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928c54-6510-462c-b8aa-b08831dd620e admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:09.660800 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97928c54-6510-462c-b8aa-b08831dd620e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:09.662441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97928c54-6510-462c-b8aa-b08831dd620e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:09.673550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1189/2351] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:09.677629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1852ca-09fe-45d1-b691-750c409e46ee admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:09.687567 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1852ca-09fe-45d1-b691-750c409e46ee admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:09.692273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e4c7a-86ec-4f03-a068-50dd7ff05ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:09.692868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e4c7a-86ec-4f03-a068-50dd7ff05ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:09.693142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e4c7a-86ec-4f03-a068-50dd7ff05ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:09.693410 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e4c7a-86ec-4f03-a068-50dd7ff05ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:09.694087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e4c7a-86ec-4f03-a068-50dd7ff05ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:09.695716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e4c7a-86ec-4f03-a068-50dd7ff05ba6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:09.833135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1163/2352] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:09.838049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928c54-6510-462c-b8aa-b08831dd620e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:09.848684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928c54-6510-462c-b8aa-b08831dd620e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:09.853710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beebd5a-2b75-4f83-a65d-04b28bbdb231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:09.854390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beebd5a-2b75-4f83-a65d-04b28bbdb231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:09.854669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beebd5a-2b75-4f83-a65d-04b28bbdb231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:09.854940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beebd5a-2b75-4f83-a65d-04b28bbdb231 admin admin] PATH_INFO: `/v3/projects/51225611f6ae4fd4a8b12fa7f5a94a3d/users/8e5c7bbdd7fa44ab8eac84608c37e47c/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:09.869665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beebd5a-2b75-4f83-a65d-04b28bbdb231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51225611f6ae4fd4a8b12fa7f5a94a3d, user_id=8e5c7bbdd7fa44ab8eac84608c37e47c, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:09.872379 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beebd5a-2b75-4f83-a65d-04b28bbdb231 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:09.957309 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1190/2353] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:28:09 2022] PUT /identity/v3/projects/51225611f6ae4fd4a8b12fa7f5a94a3d/users/8e5c7bbdd7fa44ab8eac84608c37e47c/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:09.969314 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f1a21-ba80-4086-a67f-a4675b2dfb0d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:09.969619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f1a21-ba80-4086-a67f-a4675b2dfb0d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:09.969890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f1a21-ba80-4086-a67f-a4675b2dfb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:09.999299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-025f1a21-ba80-4086-a67f-a4675b2dfb0d None None] MFA Rules not processed for user `8e5c7bbdd7fa44ab8eac84608c37e47c`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:10.000525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-025f1a21-ba80-4086-a67f-a4675b2dfb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:10.065234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1164/2354] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:28:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:10.076084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beebd5a-2b75-4f83-a65d-04b28bbdb231 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:10.077752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7beebd5a-2b75-4f83-a65d-04b28bbdb231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:10.139075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beebd5a-2b75-4f83-a65d-04b28bbdb231 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:10.142810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b42e5f-eb72-4214-9992-418bb34cca4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:10.143418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42e5f-eb72-4214-9992-418bb34cca4e service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:10.143689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42e5f-eb72-4214-9992-418bb34cca4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:10.147756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42e5f-eb72-4214-9992-418bb34cca4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:10.156317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b42e5f-eb72-4214-9992-418bb34cca4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:10.157766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b42e5f-eb72-4214-9992-418bb34cca4e service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:10.168473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1191/2355] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:20.062316 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:20.163330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:22.631361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0d4ff-4e66-4846-8a64-0b9ea4fc0b4d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:22.631843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0d4ff-4e66-4846-8a64-0b9ea4fc0b4d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:22.631937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0d4ff-4e66-4846-8a64-0b9ea4fc0b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:22.652700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-12a0d4ff-4e66-4846-8a64-0b9ea4fc0b4d None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:22.653895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-12a0d4ff-4e66-4846-8a64-0b9ea4fc0b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:22.713889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1165/2356] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:28:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:22.757063 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b42e5f-eb72-4214-9992-418bb34cca4e service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:22.758516 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-81b42e5f-eb72-4214-9992-418bb34cca4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:22.839346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b42e5f-eb72-4214-9992-418bb34cca4e service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:22.844485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a0629-8d3a-4223-b480-19246a84c2f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:22.845089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a0629-8d3a-4223-b480-19246a84c2f6 service swift] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:22.845363 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a0629-8d3a-4223-b480-19246a84c2f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:22.845631 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a0629-8d3a-4223-b480-19246a84c2f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:22.854578 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a0629-8d3a-4223-b480-19246a84c2f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:22.856233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a0629-8d3a-4223-b480-19246a84c2f6 service swift] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:22.864959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1192/2357] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:28:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:28:32.706164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=25 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:32.861786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=32 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:33.616478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0d4ff-4e66-4846-8a64-0b9ea4fc0b4d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:33.718492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0d4ff-4e66-4846-8a64-0b9ea4fc0b4d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:33.724613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:33.725699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:33.726215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:33.726600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] PATH_INFO: `/v3/users/8e5c7bbdd7fa44ab8eac84608c37e47c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:33.728946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5c7bbdd7fa44ab8eac84608c37e47c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:33.733431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:34.013627 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5c7bbdd7fa44ab8eac84608c37e47c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:34.016026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5c7bbdd7fa44ab8eac84608c37e47c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:34.028243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5c7bbdd7fa44ab8eac84608c37e47c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:34.029345 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5c7bbdd7fa44ab8eac84608c37e47c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:34.123058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5c7bbdd7fa44ab8eac84608c37e47c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:34.174357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1166/2358] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:28:33 2022] DELETE /identity/v3/users/8e5c7bbdd7fa44ab8eac84608c37e47c => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:34.184636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4ca44-cd87-4d76-88a5-4de15f979723 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:34.188479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4ca44-cd87-4d76-88a5-4de15f979723 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:34.188479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4ca44-cd87-4d76-88a5-4de15f979723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:34.213028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c1f4ca44-cd87-4d76-88a5-4de15f979723 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:34.214285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c1f4ca44-cd87-4d76-88a5-4de15f979723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:34.319229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1193/2359] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:34.331471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:34.333056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:34.412813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805adf1a-005a-4188-a39f-b61d650b9e17 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:34.417607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c49578-0b18-47ae-9e9e-272cba3ab2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:34.418952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49578-0b18-47ae-9e9e-272cba3ab2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:34.419356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49578-0b18-47ae-9e9e-272cba3ab2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:34.419740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49578-0b18-47ae-9e9e-272cba3ab2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:34.434012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c49578-0b18-47ae-9e9e-272cba3ab2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:34.435898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c49578-0b18-47ae-9e9e-272cba3ab2b2 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:34.447830 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1167/2360] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:35.101473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4ca44-cd87-4d76-88a5-4de15f979723 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:35.103121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c1f4ca44-cd87-4d76-88a5-4de15f979723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:35.120392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4ca44-cd87-4d76-88a5-4de15f979723 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:35.125231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:35.127121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:35.127409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:35.127685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] PATH_INFO: `/v3/projects/51225611f6ae4fd4a8b12fa7f5a94a3d` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:35.129054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51225611f6ae4fd4a8b12fa7f5a94a3d)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:35.131259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:35.254425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51225611f6ae4fd4a8b12fa7f5a94a3d', 'request_id': 'req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:35.264660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51225611f6ae4fd4a8b12fa7f5a94a3d', 'request_id': 'req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:35.344756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51225611f6ae4fd4a8b12fa7f5a94a3d', 'request_id': 'req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:35.359661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] The token cache is being invalidate because project 51225611f6ae4fd4a8b12fa7f5a94a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:28:35.359948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:35.360624 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:35.362532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1194/2361] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:28:35 2022] DELETE /identity/v3/projects/51225611f6ae4fd4a8b12fa7f5a94a3d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:40.245584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050068-2d82-422a-bca4-d2ffd621eb62 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:40.245584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050068-2d82-422a-bca4-d2ffd621eb62 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:40.245584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050068-2d82-422a-bca4-d2ffd621eb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:40.266944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-73050068-2d82-422a-bca4-d2ffd621eb62 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:40.268164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-73050068-2d82-422a-bca4-d2ffd621eb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:40.299900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:40.350818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1168/2362] 10.222.0.46 () {58 vars in 967 bytes} [Thu Aug 4 05:28:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:40.364708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:40.366560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:40.442576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5f438-b8cf-4ac7-82ea-97af7dd95911 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:40.448042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1639a0f-d4e6-487e-a439-bed064519b8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:40.448657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1639a0f-d4e6-487e-a439-bed064519b8f service swift] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:40.448929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1639a0f-d4e6-487e-a439-bed064519b8f service swift] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:40.449205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1639a0f-d4e6-487e-a439-bed064519b8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:40.457703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1639a0f-d4e6-487e-a439-bed064519b8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:40.459388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1639a0f-d4e6-487e-a439-bed064519b8f service swift] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:40.468737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1195/2363] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:28:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:28:43.525953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050068-2d82-422a-bca4-d2ffd621eb62 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:43.527727 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-73050068-2d82-422a-bca4-d2ffd621eb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:43.617723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050068-2d82-422a-bca4-d2ffd621eb62 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:43.635164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:43.636290 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:43.640995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:43.640995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] PATH_INFO: `/v3/users/02d384cc766b4ef8bc0498f8fe3e5566` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:43.640995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d384cc766b4ef8bc0498f8fe3e5566)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:43.644139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:44.007096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d384cc766b4ef8bc0498f8fe3e5566'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:44.008046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d384cc766b4ef8bc0498f8fe3e5566'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:44.016529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d384cc766b4ef8bc0498f8fe3e5566'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:44.017267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d384cc766b4ef8bc0498f8fe3e5566'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:44.121738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d384cc766b4ef8bc0498f8fe3e5566'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:44.156530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1169/2364] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:28:43 2022] DELETE /identity/v3/users/02d384cc766b4ef8bc0498f8fe3e5566 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:44.281165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1639a0f-d4e6-487e-a439-bed064519b8f service swift] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:44.283629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c1639a0f-d4e6-487e-a439-bed064519b8f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:44.304025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:44.424265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1639a0f-d4e6-487e-a439-bed064519b8f service swift] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:44.512447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:44.513870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:44.528399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756065-593d-41ca-a6b3-cb02b7526814 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:44.529115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756065-593d-41ca-a6b3-cb02b7526814 service placement] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:44.529461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756065-593d-41ca-a6b3-cb02b7526814 service placement] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:44.529802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756065-593d-41ca-a6b3-cb02b7526814 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:44.532062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0c756065-593d-41ca-a6b3-cb02b7526814 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:44.549440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c756065-593d-41ca-a6b3-cb02b7526814 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:44.551329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c756065-593d-41ca-a6b3-cb02b7526814 service placement] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:44.597865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1196/2365] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:44.609608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:44.631216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a80c8-5fbb-479b-8799-40b3ac5b7a17 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:44.640340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:44.641042 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:44.641377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:44.641659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] PATH_INFO: `/v3/projects/ec163b07b5234a48ba80509ac693d8d3` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:44.643002 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec163b07b5234a48ba80509ac693d8d3)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:44.644959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:44.862017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec163b07b5234a48ba80509ac693d8d3', 'request_id': 'req-5145a5ab-e823-4e85-b5ad-390ad0478cd4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:44.870400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec163b07b5234a48ba80509ac693d8d3', 'request_id': 'req-5145a5ab-e823-4e85-b5ad-390ad0478cd4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:44.950444 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec163b07b5234a48ba80509ac693d8d3', 'request_id': 'req-5145a5ab-e823-4e85-b5ad-390ad0478cd4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:44.962111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] The token cache is being invalidate because project ec163b07b5234a48ba80509ac693d8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:28:44.963169 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:44.963910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5145a5ab-e823-4e85-b5ad-390ad0478cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:44.965420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1170/2366] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:28:44 2022] DELETE /identity/v3/projects/ec163b07b5234a48ba80509ac693d8d3 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:28:44.971311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01748e-7835-444c-bafb-05675c646739 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:44.971606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01748e-7835-444c-bafb-05675c646739 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:44.971898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01748e-7835-444c-bafb-05675c646739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:44.994140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ee01748e-7835-444c-bafb-05675c646739 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:44.995767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ee01748e-7835-444c-bafb-05675c646739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:45.072959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1197/2367] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:45.080393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79ba9b-34a3-4404-9d63-a8958fdd787f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:45.080687 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79ba9b-34a3-4404-9d63-a8958fdd787f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:45.080967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79ba9b-34a3-4404-9d63-a8958fdd787f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:45.112960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ed79ba9b-34a3-4404-9d63-a8958fdd787f None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:45.114260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ed79ba9b-34a3-4404-9d63-a8958fdd787f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:45.126043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1171/2368] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:45.129740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01748e-7835-444c-bafb-05675c646739 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:45.146062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01748e-7835-444c-bafb-05675c646739 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:45.174460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccc476-afea-419a-abd6-ea8633d548fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:45.175204 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccc476-afea-419a-abd6-ea8633d548fc admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:45.175586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccc476-afea-419a-abd6-ea8633d548fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:45.175964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccc476-afea-419a-abd6-ea8633d548fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:45.177027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccc476-afea-419a-abd6-ea8633d548fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:28:45.177432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccc476-afea-419a-abd6-ea8633d548fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:45.180452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccc476-afea-419a-abd6-ea8633d548fc admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:45.198521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1198/2369] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:28:45.199638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79ba9b-34a3-4404-9d63-a8958fdd787f None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:45.213115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79ba9b-34a3-4404-9d63-a8958fdd787f None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:45.218679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794be14-f512-4def-a80c-6837da7357b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:45.219317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794be14-f512-4def-a80c-6837da7357b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:45.220301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794be14-f512-4def-a80c-6837da7357b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:45.220588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794be14-f512-4def-a80c-6837da7357b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:45.222229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794be14-f512-4def-a80c-6837da7357b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:45.225020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794be14-f512-4def-a80c-6837da7357b0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:45.361356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1172/2370] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:28:45 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:28:45.365589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccc476-afea-419a-abd6-ea8633d548fc admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:45.377941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccc476-afea-419a-abd6-ea8633d548fc admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:45.419232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:45.449876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aec73-645b-4af7-907a-27783690273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:45.450528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aec73-645b-4af7-907a-27783690273d admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:45.450807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aec73-645b-4af7-907a-27783690273d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:45.451082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aec73-645b-4af7-907a-27783690273d admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:45.451824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575aec73-645b-4af7-907a-27783690273d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:45.453791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575aec73-645b-4af7-907a-27783690273d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:45.585852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1199/2371] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:28:45 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:28:45.590789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794be14-f512-4def-a80c-6837da7357b0 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:45.602415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794be14-f512-4def-a80c-6837da7357b0 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:45.609700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc85fa8-05f2-4929-9e2b-72707df070ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:45.610703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc85fa8-05f2-4929-9e2b-72707df070ee admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:45.610977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc85fa8-05f2-4929-9e2b-72707df070ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:45.611642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc85fa8-05f2-4929-9e2b-72707df070ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:45.612391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc85fa8-05f2-4929-9e2b-72707df070ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:45.614039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc85fa8-05f2-4929-9e2b-72707df070ee admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:45.626638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1173/2372] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:28:45.630879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aec73-645b-4af7-907a-27783690273d admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:45.644022 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aec73-645b-4af7-907a-27783690273d admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:45.653996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574853a-4611-4e15-9cf3-53c48eb0cccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:45.654654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574853a-4611-4e15-9cf3-53c48eb0cccb admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:45.654929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574853a-4611-4e15-9cf3-53c48eb0cccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:45.655200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574853a-4611-4e15-9cf3-53c48eb0cccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:45.655893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574853a-4611-4e15-9cf3-53c48eb0cccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:45.657919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574853a-4611-4e15-9cf3-53c48eb0cccb admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:45.672996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1200/2373] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:45.678626 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc85fa8-05f2-4929-9e2b-72707df070ee admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:45.689619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc85fa8-05f2-4929-9e2b-72707df070ee admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:45.694907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3208ad-d1ec-4a7e-ad45-cccdb4812050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:45.695608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3208ad-d1ec-4a7e-ad45-cccdb4812050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:45.695881 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3208ad-d1ec-4a7e-ad45-cccdb4812050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:45.696151 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3208ad-d1ec-4a7e-ad45-cccdb4812050 admin admin] PATH_INFO: `/v3/projects/71133a71e1104bdbaa71805f15c96013/users/fc21ad448daa482e8d973864a65425f8/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:45.714015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3208ad-d1ec-4a7e-ad45-cccdb4812050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71133a71e1104bdbaa71805f15c96013, user_id=fc21ad448daa482e8d973864a65425f8, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:45.716827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3208ad-d1ec-4a7e-ad45-cccdb4812050 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:45.842532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1174/2374] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:28:45 2022] PUT /identity/v3/projects/71133a71e1104bdbaa71805f15c96013/users/fc21ad448daa482e8d973864a65425f8/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:45.852541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17cf9-5a82-4642-b7b2-a0a6fba3040c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:45.853420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17cf9-5a82-4642-b7b2-a0a6fba3040c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:45.853811 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17cf9-5a82-4642-b7b2-a0a6fba3040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:45.889417 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-43b17cf9-5a82-4642-b7b2-a0a6fba3040c None None] MFA Rules not processed for user `fc21ad448daa482e8d973864a65425f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:45.892854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-43b17cf9-5a82-4642-b7b2-a0a6fba3040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:45.967405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1201/2375] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:28:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:45.979518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3208ad-d1ec-4a7e-ad45-cccdb4812050 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:45.981213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3d3208ad-d1ec-4a7e-ad45-cccdb4812050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:46.049034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3208ad-d1ec-4a7e-ad45-cccdb4812050 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:46.053590 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913d77b-6575-4497-9372-47defe984f06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc9a884f16149cda246ea9638621296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:46.054234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d77b-6575-4497-9372-47defe984f06 service glance] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.054555 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d77b-6575-4497-9372-47defe984f06 service glance] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.054941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d77b-6575-4497-9372-47defe984f06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.072841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913d77b-6575-4497-9372-47defe984f06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:46.074525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913d77b-6575-4497-9372-47defe984f06 service glance] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:46.086136 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1175/2376] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:55.964133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=51,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:56.081268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:04.849517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc5dda-f00a-43ca-b303-1ffae63df7fe None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:04.850102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc5dda-f00a-43ca-b303-1ffae63df7fe None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:04.850102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc5dda-f00a-43ca-b303-1ffae63df7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:04.869052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f5fc5dda-f00a-43ca-b303-1ffae63df7fe None None] MFA Rules not processed for user `9cb49b631c234f9a9fd47049b9b2e097`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:04.874111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f5fc5dda-f00a-43ca-b303-1ffae63df7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:04.925649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1202/2377] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:29:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:14.918856 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=25 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:15.439464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043207f-68bc-4bed-a86f-8fda8015f07f None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:15.439464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043207f-68bc-4bed-a86f-8fda8015f07f None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:15.439464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043207f-68bc-4bed-a86f-8fda8015f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:15.458750 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-a043207f-68bc-4bed-a86f-8fda8015f07f None None] MFA Rules not processed for user `ab8f887f5689419e9e31a0ba43f76ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:15.460222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a043207f-68bc-4bed-a86f-8fda8015f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:15.522958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1176/2378] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:29:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:16.843531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc5dda-f00a-43ca-b303-1ffae63df7fe None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:16.911028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc5dda-f00a-43ca-b303-1ffae63df7fe None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:16.917286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:16.918079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:16.918385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:16.918725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] PATH_INFO: `/v3/users/fc21ad448daa482e8d973864a65425f8` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:16.921025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc21ad448daa482e8d973864a65425f8)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:16.923035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:17.135570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc21ad448daa482e8d973864a65425f8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:17.136242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc21ad448daa482e8d973864a65425f8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:17.145178 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc21ad448daa482e8d973864a65425f8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:17.158748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc21ad448daa482e8d973864a65425f8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:17.235544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc21ad448daa482e8d973864a65425f8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:17.242550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1203/2379] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:29:16 2022] DELETE /identity/v3/users/fc21ad448daa482e8d973864a65425f8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:17.246993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba5c55-9d79-4120-8d1d-ea82f605b7d9 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:17.247530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba5c55-9d79-4120-8d1d-ea82f605b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:17.247530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba5c55-9d79-4120-8d1d-ea82f605b7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:17.267324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-afba5c55-9d79-4120-8d1d-ea82f605b7d9 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:17.268568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-afba5c55-9d79-4120-8d1d-ea82f605b7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:17.330807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1177/2380] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:17.340850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:17.343042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:17.401699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305106c-7929-4dd5-8ff9-bc02b11299b5 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:17.406012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d1a94-1a0b-41cf-9c33-eea35582a4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:17.406915 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d1a94-1a0b-41cf-9c33-eea35582a4fb service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:17.407200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d1a94-1a0b-41cf-9c33-eea35582a4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:17.407469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d1a94-1a0b-41cf-9c33-eea35582a4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:17.417604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d1a94-1a0b-41cf-9c33-eea35582a4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:17.419143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d1a94-1a0b-41cf-9c33-eea35582a4fb service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:17.429269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1204/2381] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:17.956964 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba5c55-9d79-4120-8d1d-ea82f605b7d9 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:17.958494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-afba5c55-9d79-4120-8d1d-ea82f605b7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:17.971015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba5c55-9d79-4120-8d1d-ea82f605b7d9 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:17.976009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:17.976787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:17.977048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:17.977350 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] PATH_INFO: `/v3/projects/71133a71e1104bdbaa71805f15c96013` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:17.978605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71133a71e1104bdbaa71805f15c96013)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:17.980538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.111365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71133a71e1104bdbaa71805f15c96013', 'request_id': 'req-abdc3e8d-1274-41fb-9eae-c6f717d0a555'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:18.117621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71133a71e1104bdbaa71805f15c96013', 'request_id': 'req-abdc3e8d-1274-41fb-9eae-c6f717d0a555'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:18.223803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71133a71e1104bdbaa71805f15c96013', 'request_id': 'req-abdc3e8d-1274-41fb-9eae-c6f717d0a555'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:18.235624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] The token cache is being invalidate because project 71133a71e1104bdbaa71805f15c96013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:29:18.235913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:18.239098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-abdc3e8d-1274-41fb-9eae-c6f717d0a555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:18.239098 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1178/2382] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:29:17 2022] DELETE /identity/v3/projects/71133a71e1104bdbaa71805f15c96013 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:18.243660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042c99f-28c2-4aff-b19b-daa003a23f7e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.244430 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042c99f-28c2-4aff-b19b-daa003a23f7e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.244592 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042c99f-28c2-4aff-b19b-daa003a23f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.268106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b042c99f-28c2-4aff-b19b-daa003a23f7e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:18.269312 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b042c99f-28c2-4aff-b19b-daa003a23f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:18.288135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:18.331621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1205/2383] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:29:18.340615 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638c864-4678-4bb8-acd3-3e28a62a34a7 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.341148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638c864-4678-4bb8-acd3-3e28a62a34a7 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.341148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638c864-4678-4bb8-acd3-3e28a62a34a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.363748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9638c864-4678-4bb8-acd3-3e28a62a34a7 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:18.365243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9638c864-4678-4bb8-acd3-3e28a62a34a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:18.374378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1179/2384] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:18.378505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042c99f-28c2-4aff-b19b-daa003a23f7e None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.388840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042c99f-28c2-4aff-b19b-daa003a23f7e None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.393751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd120f-65d5-4dc7-ae1d-291eb1c96c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.394397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd120f-65d5-4dc7-ae1d-291eb1c96c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.394677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd120f-65d5-4dc7-ae1d-291eb1c96c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.399558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd120f-65d5-4dc7-ae1d-291eb1c96c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.399558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd120f-65d5-4dc7-ae1d-291eb1c96c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:29:18.399558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd120f-65d5-4dc7-ae1d-291eb1c96c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.399558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd120f-65d5-4dc7-ae1d-291eb1c96c1e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.410155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1206/2385] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:29:18.414651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638c864-4678-4bb8-acd3-3e28a62a34a7 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.424607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638c864-4678-4bb8-acd3-3e28a62a34a7 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.429257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081de159-e709-48fc-b461-723c59c02fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.429971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081de159-e709-48fc-b461-723c59c02fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.430248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081de159-e709-48fc-b461-723c59c02fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.430541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081de159-e709-48fc-b461-723c59c02fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.431196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081de159-e709-48fc-b461-723c59c02fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.433085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081de159-e709-48fc-b461-723c59c02fc6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.539520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:18.546883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1180/2386] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:18.551253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd120f-65d5-4dc7-ae1d-291eb1c96c1e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.563372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd120f-65d5-4dc7-ae1d-291eb1c96c1e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.621907 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b26747-592b-4e36-aa1d-30dde3c270fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.622554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b26747-592b-4e36-aa1d-30dde3c270fa admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.622826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b26747-592b-4e36-aa1d-30dde3c270fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.623094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b26747-592b-4e36-aa1d-30dde3c270fa admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.624502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b26747-592b-4e36-aa1d-30dde3c270fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.626473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b26747-592b-4e36-aa1d-30dde3c270fa admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.722762 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1207/2387] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:18.727143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081de159-e709-48fc-b461-723c59c02fc6 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.739147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081de159-e709-48fc-b461-723c59c02fc6 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.744355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181d600-a6cf-4633-ad1e-308de55b744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.745228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181d600-a6cf-4633-ad1e-308de55b744f admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.745563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181d600-a6cf-4633-ad1e-308de55b744f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.745946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181d600-a6cf-4633-ad1e-308de55b744f admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.746789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181d600-a6cf-4633-ad1e-308de55b744f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.749293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181d600-a6cf-4633-ad1e-308de55b744f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.763526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1181/2388] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:29:18.768086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b26747-592b-4e36-aa1d-30dde3c270fa admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.778359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b26747-592b-4e36-aa1d-30dde3c270fa admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.784470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275f3c-6148-40db-95bf-19eef6f5b610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.785106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275f3c-6148-40db-95bf-19eef6f5b610 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.785369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275f3c-6148-40db-95bf-19eef6f5b610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.785641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275f3c-6148-40db-95bf-19eef6f5b610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.786362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275f3c-6148-40db-95bf-19eef6f5b610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.787960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275f3c-6148-40db-95bf-19eef6f5b610 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.803132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1208/2389] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:29:18.804576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181d600-a6cf-4633-ad1e-308de55b744f admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.817008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181d600-a6cf-4633-ad1e-308de55b744f admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.823749 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f8eb0-34a0-4d17-a3bc-fa2e0bfa1bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.824436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f8eb0-34a0-4d17-a3bc-fa2e0bfa1bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.824709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f8eb0-34a0-4d17-a3bc-fa2e0bfa1bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.824981 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f8eb0-34a0-4d17-a3bc-fa2e0bfa1bc8 admin admin] PATH_INFO: `/v3/projects/520d3d5e2e804be1bd5dc9bfc50c5de8/users/5af2248451d3483d9742887d614a5077/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.842038 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f8eb0-34a0-4d17-a3bc-fa2e0bfa1bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520d3d5e2e804be1bd5dc9bfc50c5de8, user_id=5af2248451d3483d9742887d614a5077, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.845586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f8eb0-34a0-4d17-a3bc-fa2e0bfa1bc8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.973568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1182/2390] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:29:18 2022] PUT /identity/v3/projects/520d3d5e2e804be1bd5dc9bfc50c5de8/users/5af2248451d3483d9742887d614a5077/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:29:18.978708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2ec7-b7a7-497e-80bb-5c11d7272c9c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.979064 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2ec7-b7a7-497e-80bb-5c11d7272c9c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.979256 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2ec7-b7a7-497e-80bb-5c11d7272c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:19.000685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f4db2ec7-b7a7-497e-80bb-5c11d7272c9c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:19.002037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f4db2ec7-b7a7-497e-80bb-5c11d7272c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:19.084228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1209/2391] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:19.091399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f8eb0-34a0-4d17-a3bc-fa2e0bfa1bc8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:19.094017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a40f8eb0-34a0-4d17-a3bc-fa2e0bfa1bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:19.175699 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f8eb0-34a0-4d17-a3bc-fa2e0bfa1bc8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:19.179562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277d0a-0ff1-4142-9d21-119955786a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:19.180182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277d0a-0ff1-4142-9d21-119955786a81 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:19.180455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277d0a-0ff1-4142-9d21-119955786a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:19.180724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277d0a-0ff1-4142-9d21-119955786a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:19.190568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23277d0a-0ff1-4142-9d21-119955786a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:19.192010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23277d0a-0ff1-4142-9d21-119955786a81 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:19.202257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1183/2392] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:29:20.718397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92dd66-88e3-4f3a-9f54-121a3347921e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:20.718981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92dd66-88e3-4f3a-9f54-121a3347921e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:20.719114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92dd66-88e3-4f3a-9f54-121a3347921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:20.749984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ea92dd66-88e3-4f3a-9f54-121a3347921e None None] MFA Rules not processed for user `5af2248451d3483d9742887d614a5077`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:20.751267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ea92dd66-88e3-4f3a-9f54-121a3347921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:20.780211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:20.846740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1210/2393] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:20.859089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277d0a-0ff1-4142-9d21-119955786a81 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:20.860580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-23277d0a-0ff1-4142-9d21-119955786a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:20.930727 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277d0a-0ff1-4142-9d21-119955786a81 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:20.937895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b6231-4c78-45b9-82c6-b1e9a823405b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:20.941179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b6231-4c78-45b9-82c6-b1e9a823405b service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:20.941179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b6231-4c78-45b9-82c6-b1e9a823405b service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:20.941179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b6231-4c78-45b9-82c6-b1e9a823405b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:20.949498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b6231-4c78-45b9-82c6-b1e9a823405b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:20.952493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b6231-4c78-45b9-82c6-b1e9a823405b service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:20.964318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1184/2394] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:22.875949 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479951e-f323-4653-b9fa-8f936846155e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:22.876515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479951e-f323-4653-b9fa-8f936846155e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:22.876515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479951e-f323-4653-b9fa-8f936846155e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:22.895432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f479951e-f323-4653-b9fa-8f936846155e None None] MFA Rules not processed for user `5af2248451d3483d9742887d614a5077`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:22.896741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f479951e-f323-4653-b9fa-8f936846155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:22.906227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1211/2395] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:29:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:30.958556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:32.889740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=22 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:08.777970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b6231-4c78-45b9-82c6-b1e9a823405b service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:08.779569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-da8b6231-4c78-45b9-82c6-b1e9a823405b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:08.792043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b6231-4c78-45b9-82c6-b1e9a823405b service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:08.795685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15f849-5c07-4026-a1cb-ce6be2d50c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:08.796291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15f849-5c07-4026-a1cb-ce6be2d50c0f service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:08.796569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15f849-5c07-4026-a1cb-ce6be2d50c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:08.796842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15f849-5c07-4026-a1cb-ce6be2d50c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:08.798600 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2f15f849-5c07-4026-a1cb-ce6be2d50c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:08.879959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15f849-5c07-4026-a1cb-ce6be2d50c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:08.881436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15f849-5c07-4026-a1cb-ce6be2d50c0f service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:08.892795 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1185/2396] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:30:10.080140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479951e-f323-4653-b9fa-8f936846155e None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:10.090534 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479951e-f323-4653-b9fa-8f936846155e None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:10.094822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37245842-540f-49f8-9f88-9b7339156932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:10.095446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37245842-540f-49f8-9f88-9b7339156932 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:10.095709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37245842-540f-49f8-9f88-9b7339156932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:10.095976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37245842-540f-49f8-9f88-9b7339156932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:10.098667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-37245842-540f-49f8-9f88-9b7339156932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:10.112430 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37245842-540f-49f8-9f88-9b7339156932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:10.113874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37245842-540f-49f8-9f88-9b7339156932 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:10.124768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1212/2397] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:10.202197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15f849-5c07-4026-a1cb-ce6be2d50c0f service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:10.203719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2f15f849-5c07-4026-a1cb-ce6be2d50c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:10.219344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15f849-5c07-4026-a1cb-ce6be2d50c0f service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:10.226548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd34474-382a-4895-8067-ef64cbfe8783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:10.227172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34474-382a-4895-8067-ef64cbfe8783 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:10.227451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34474-382a-4895-8067-ef64cbfe8783 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:10.227932 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34474-382a-4895-8067-ef64cbfe8783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:10.229824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cbd34474-382a-4895-8067-ef64cbfe8783 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:10.290648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd34474-382a-4895-8067-ef64cbfe8783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:10.292157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd34474-382a-4895-8067-ef64cbfe8783 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:10.301399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1186/2398] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:14.780220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37245842-540f-49f8-9f88-9b7339156932 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:14.781871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-37245842-540f-49f8-9f88-9b7339156932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:14.796232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37245842-540f-49f8-9f88-9b7339156932 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:14.801753 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bbdd3-a34e-41e8-a1e0-1f2a2c37e438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:14.803177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bbdd3-a34e-41e8-a1e0-1f2a2c37e438 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:14.803457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bbdd3-a34e-41e8-a1e0-1f2a2c37e438 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:14.803729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bbdd3-a34e-41e8-a1e0-1f2a2c37e438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:14.805446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f43bbdd3-a34e-41e8-a1e0-1f2a2c37e438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:14.863902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bbdd3-a34e-41e8-a1e0-1f2a2c37e438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:14.866596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bbdd3-a34e-41e8-a1e0-1f2a2c37e438 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:14.875896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1213/2399] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:20.296997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=62 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:24.871538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=34 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:30.479801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd34474-382a-4895-8067-ef64cbfe8783 service nova] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:30.490159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd34474-382a-4895-8067-ef64cbfe8783 service nova] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:30.494993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf399b-fe21-4da0-8666-d1b63e5a28aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:30.495698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf399b-fe21-4da0-8666-d1b63e5a28aa service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:30.495983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf399b-fe21-4da0-8666-d1b63e5a28aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:30.496256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf399b-fe21-4da0-8666-d1b63e5a28aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:30.498473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-fbbf399b-fe21-4da0-8666-d1b63e5a28aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:30.511844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf399b-fe21-4da0-8666-d1b63e5a28aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:30.513801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf399b-fe21-4da0-8666-d1b63e5a28aa service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:30.526187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1187/2400] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:40.521362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=6 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:40.749717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bbdd3-a34e-41e8-a1e0-1f2a2c37e438 service nova] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:40.774824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bbdd3-a34e-41e8-a1e0-1f2a2c37e438 service nova] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:40.786106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640b661-a0e7-4565-b329-b028237be9f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:40.787253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640b661-a0e7-4565-b329-b028237be9f6 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:40.787699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640b661-a0e7-4565-b329-b028237be9f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:40.788153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640b661-a0e7-4565-b329-b028237be9f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:40.790932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9640b661-a0e7-4565-b329-b028237be9f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:40.821559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640b661-a0e7-4565-b329-b028237be9f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:40.824528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640b661-a0e7-4565-b329-b028237be9f6 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:40.847480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf399b-fe21-4da0-8666-d1b63e5a28aa service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:40.863347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1214/2401] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:40.871622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf399b-fe21-4da0-8666-d1b63e5a28aa service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:40.879670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f293d-4831-42af-a2d2-4d7bf7d3e9c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:40.880660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f293d-4831-42af-a2d2-4d7bf7d3e9c9 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:40.881505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f293d-4831-42af-a2d2-4d7bf7d3e9c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:40.882534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f293d-4831-42af-a2d2-4d7bf7d3e9c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:40.884977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-485f293d-4831-42af-a2d2-4d7bf7d3e9c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:40.912960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f293d-4831-42af-a2d2-4d7bf7d3e9c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:40.916395 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f293d-4831-42af-a2d2-4d7bf7d3e9c9 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:40.946828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1188/2402] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:30:42.976350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640b661-a0e7-4565-b329-b028237be9f6 service nova] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:43.010206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640b661-a0e7-4565-b329-b028237be9f6 service nova] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:43.018251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855eec-1daa-4dd0-9460-6fb81ab08d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:43.019560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855eec-1daa-4dd0-9460-6fb81ab08d37 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:43.025539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855eec-1daa-4dd0-9460-6fb81ab08d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:43.025539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855eec-1daa-4dd0-9460-6fb81ab08d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:43.025539 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d4855eec-1daa-4dd0-9460-6fb81ab08d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:43.056209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4855eec-1daa-4dd0-9460-6fb81ab08d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:43.056209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4855eec-1daa-4dd0-9460-6fb81ab08d37 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:43.075116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1215/2403] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:43.534282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d16c4-97dc-4438-aca9-c701a8e92579 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:43.535233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d16c4-97dc-4438-aca9-c701a8e92579 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:43.535683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d16c4-97dc-4438-aca9-c701a8e92579 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:43.537059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1189/2404] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:30:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:30:43.544217 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8695-a6e5-4886-b1c8-8f9b10c1ad1b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:43.544506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8695-a6e5-4886-b1c8-8f9b10c1ad1b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:43.544783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8695-a6e5-4886-b1c8-8f9b10c1ad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:43.583046 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-172c8695-a6e5-4886-b1c8-8f9b10c1ad1b None None] MFA Rules not processed for user `4213a478acfe4cc88df41b3da2d581ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:30:43.588425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-172c8695-a6e5-4886-b1c8-8f9b10c1ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:43.624797 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1216/2405] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:30:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:30:43.641099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d16c4-97dc-4438-aca9-c701a8e92579 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:43.652928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d16c4-97dc-4438-aca9-c701a8e92579 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:43.660355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5514-e90f-4f6d-b827-79a8871fdae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:43.661890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5514-e90f-4f6d-b827-79a8871fdae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:43.662386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5514-e90f-4f6d-b827-79a8871fdae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:43.662814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5514-e90f-4f6d-b827-79a8871fdae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:43.672930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec5514-e90f-4f6d-b827-79a8871fdae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:43.674402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec5514-e90f-4f6d-b827-79a8871fdae5 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:43.687716 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1190/2406] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:43.824177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dad40-8f07-4cb5-8c5a-23dcebd5c5a2 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:43.824668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dad40-8f07-4cb5-8c5a-23dcebd5c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:43.825051 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dad40-8f07-4cb5-8c5a-23dcebd5c5a2 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:43.829700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1217/2407] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:30:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:30:43.835157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473069f-f7a9-4434-8dc7-17854c7c9bc5 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:43.835917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473069f-f7a9-4434-8dc7-17854c7c9bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:43.836373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473069f-f7a9-4434-8dc7-17854c7c9bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:43.888776 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-1473069f-f7a9-4434-8dc7-17854c7c9bc5 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:30:43.890804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1473069f-f7a9-4434-8dc7-17854c7c9bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:43.906086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1191/2408] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:30:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:30:43.929643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dad40-8f07-4cb5-8c5a-23dcebd5c5a2 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:43.963488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dad40-8f07-4cb5-8c5a-23dcebd5c5a2 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:43.976544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66207c1f-668d-4036-84e1-0a1565111fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:43.977244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66207c1f-668d-4036-84e1-0a1565111fcb service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:43.977785 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66207c1f-668d-4036-84e1-0a1565111fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:43.978759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66207c1f-668d-4036-84e1-0a1565111fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:44.002994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66207c1f-668d-4036-84e1-0a1565111fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:44.005623 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66207c1f-668d-4036-84e1-0a1565111fcb service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:44.040454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1218/2409] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:44.153814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473069f-f7a9-4434-8dc7-17854c7c9bc5 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:44.155525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1473069f-f7a9-4434-8dc7-17854c7c9bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:44.317150 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473069f-f7a9-4434-8dc7-17854c7c9bc5 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:44.325562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e018a-b104-4a99-9f6f-2a1c42708aff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:44.326577 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e018a-b104-4a99-9f6f-2a1c42708aff service placement] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:44.327355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e018a-b104-4a99-9f6f-2a1c42708aff service placement] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:44.328134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e018a-b104-4a99-9f6f-2a1c42708aff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:44.340197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-562e018a-b104-4a99-9f6f-2a1c42708aff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:44.352330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66207c1f-668d-4036-84e1-0a1565111fcb service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:44.364791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66207c1f-668d-4036-84e1-0a1565111fcb service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:44.365023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e018a-b104-4a99-9f6f-2a1c42708aff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:44.367706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e018a-b104-4a99-9f6f-2a1c42708aff service placement] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:44.372943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ecc14-bf00-4750-a474-618309f77eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:44.373969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ecc14-bf00-4750-a474-618309f77eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:44.374892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ecc14-bf00-4750-a474-618309f77eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:44.379450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ecc14-bf00-4750-a474-618309f77eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:44.385245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1192/2410] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:44.386006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6b0ecc14-bf00-4750-a474-618309f77eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:44.420686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ecc14-bf00-4750-a474-618309f77eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:44.420686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ecc14-bf00-4750-a474-618309f77eb1 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:44.426203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1219/2411] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:49.943153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e018a-b104-4a99-9f6f-2a1c42708aff service placement] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:49.945544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-562e018a-b104-4a99-9f6f-2a1c42708aff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:49.959980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e018a-b104-4a99-9f6f-2a1c42708aff service placement] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:49.965791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db9fbe-dfaa-4c28-a64b-8b24c18abd4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:49.966491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db9fbe-dfaa-4c28-a64b-8b24c18abd4a service placement] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:49.967187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db9fbe-dfaa-4c28-a64b-8b24c18abd4a service placement] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:49.967522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db9fbe-dfaa-4c28-a64b-8b24c18abd4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:49.972045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-16db9fbe-dfaa-4c28-a64b-8b24c18abd4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:49.986397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db9fbe-dfaa-4c28-a64b-8b24c18abd4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:49.992126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db9fbe-dfaa-4c28-a64b-8b24c18abd4a service placement] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:50.003050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1193/2412] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:30:50.165791 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ecc14-bf00-4750-a474-618309f77eb1 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:50.167271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6b0ecc14-bf00-4750-a474-618309f77eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:50.182542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ecc14-bf00-4750-a474-618309f77eb1 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:50.208669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:50.209629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:50.210621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:50.211049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] PATH_INFO: `/v3/users/ab8f887f5689419e9e31a0ba43f76ada` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:50.212620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8f887f5689419e9e31a0ba43f76ada)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:50.216305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:50.430985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8f887f5689419e9e31a0ba43f76ada'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:50.433932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8f887f5689419e9e31a0ba43f76ada'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:50.446250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8f887f5689419e9e31a0ba43f76ada'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:50.485447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8f887f5689419e9e31a0ba43f76ada'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:50.621983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8f887f5689419e9e31a0ba43f76ada'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:50.630062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1220/2413] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:30:50 2022] DELETE /identity/v3/users/ab8f887f5689419e9e31a0ba43f76ada => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:30:51.154029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680b49-f373-4503-b847-e05a67dfdffc None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:51.155768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680b49-f373-4503-b847-e05a67dfdffc None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:51.156214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680b49-f373-4503-b847-e05a67dfdffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:51.188026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:51.189573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:51.206844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-30680b49-f373-4503-b847-e05a67dfdffc None None] MFA Rules not processed for user `eb4dea95659c473b9b193c6234186430`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:30:51.215087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-30680b49-f373-4503-b847-e05a67dfdffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:51.330779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2636-be94-4dc6-a337-5a5765b707de admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:51.332986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1194/2414] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:30:51.343924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:51.344607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:51.344888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:51.345163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] PATH_INFO: `/v3/projects/b62d19c831574f9b99c993b5e41c645d` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:51.348638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62d19c831574f9b99c993b5e41c645d)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:51.351416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:51.379247 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:51.515713 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62d19c831574f9b99c993b5e41c645d', 'request_id': 'req-b7915ff4-188c-47c6-b94d-6825947bbcbb'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:51.526415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62d19c831574f9b99c993b5e41c645d', 'request_id': 'req-b7915ff4-188c-47c6-b94d-6825947bbcbb'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:51.592901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62d19c831574f9b99c993b5e41c645d', 'request_id': 'req-b7915ff4-188c-47c6-b94d-6825947bbcbb'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:51.605560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] The token cache is being invalidate because project b62d19c831574f9b99c993b5e41c645d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:30:51.605980 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:51.606664 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b7915ff4-188c-47c6-b94d-6825947bbcbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:51.609045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1221/2415] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:30:51 2022] DELETE /identity/v3/projects/b62d19c831574f9b99c993b5e41c645d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:30:51.613761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69129be-2e7d-4318-8610-e164fedcdb6b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:51.614047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69129be-2e7d-4318-8610-e164fedcdb6b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:51.614343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69129be-2e7d-4318-8610-e164fedcdb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:51.635328 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fd736-6ca5-4486-8cf0-61130b696356 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:51.635904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fd736-6ca5-4486-8cf0-61130b696356 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:51.636415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fd736-6ca5-4486-8cf0-61130b696356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:51.645810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d69129be-2e7d-4318-8610-e164fedcdb6b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:30:51.648650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d69129be-2e7d-4318-8610-e164fedcdb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:51.670781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-c85fd736-6ca5-4486-8cf0-61130b696356 None None] MFA Rules not processed for user `9cb49b631c234f9a9fd47049b9b2e097`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:30:51.673154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c85fd736-6ca5-4486-8cf0-61130b696356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:51.763112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:51.802646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1195/2416] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:30:51.824381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2bbc-daee-4e30-9d3e-2a99544d8896 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:51.827438 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2bbc-daee-4e30-9d3e-2a99544d8896 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:51.828006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2bbc-daee-4e30-9d3e-2a99544d8896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:51.927111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d06c2bbc-daee-4e30-9d3e-2a99544d8896 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:30:51.930462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1222/2417] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:30:51.930650 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d06c2bbc-daee-4e30-9d3e-2a99544d8896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:51.942112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1196/2418] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:30:51.946740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fd736-6ca5-4486-8cf0-61130b696356 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:51.960011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fd736-6ca5-4486-8cf0-61130b696356 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:51.964896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1ba0d-f664-43f0-9d59-e344eeac404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:51.967391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1ba0d-f664-43f0-9d59-e344eeac404b admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:51.967391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1ba0d-f664-43f0-9d59-e344eeac404b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:51.967391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1ba0d-f664-43f0-9d59-e344eeac404b admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:51.967391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1ba0d-f664-43f0-9d59-e344eeac404b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:30:51.967391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1ba0d-f664-43f0-9d59-e344eeac404b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:51.968657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1ba0d-f664-43f0-9d59-e344eeac404b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:51.982004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1223/2419] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:30:51.986462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c2bbc-daee-4e30-9d3e-2a99544d8896 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:51.999574 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c2bbc-daee-4e30-9d3e-2a99544d8896 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:52.010404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105dcf2-3adb-4bff-95c8-70cca5501a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:52.010819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105dcf2-3adb-4bff-95c8-70cca5501a7c admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:52.011853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105dcf2-3adb-4bff-95c8-70cca5501a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:52.012513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105dcf2-3adb-4bff-95c8-70cca5501a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:52.013540 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105dcf2-3adb-4bff-95c8-70cca5501a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:52.015480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105dcf2-3adb-4bff-95c8-70cca5501a7c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:52.123123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1197/2420] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:30:51 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:30:52.127610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1ba0d-f664-43f0-9d59-e344eeac404b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:52.139971 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1ba0d-f664-43f0-9d59-e344eeac404b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:52.214590 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603889-a08e-44a9-9ef3-0f8f9b60dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:52.215288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603889-a08e-44a9-9ef3-0f8f9b60dd9b admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:52.215469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603889-a08e-44a9-9ef3-0f8f9b60dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:52.215740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603889-a08e-44a9-9ef3-0f8f9b60dd9b admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:52.216409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d603889-a08e-44a9-9ef3-0f8f9b60dd9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:52.221847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d603889-a08e-44a9-9ef3-0f8f9b60dd9b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:52.351691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1224/2421] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:30:52 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:30:52.358529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105dcf2-3adb-4bff-95c8-70cca5501a7c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:52.378676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105dcf2-3adb-4bff-95c8-70cca5501a7c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:52.395075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b83ca-ab6b-482e-9407-d483913f4844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:52.395835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b83ca-ab6b-482e-9407-d483913f4844 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:52.396284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b83ca-ab6b-482e-9407-d483913f4844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:52.396867 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b83ca-ab6b-482e-9407-d483913f4844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:52.398790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b83ca-ab6b-482e-9407-d483913f4844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:52.400330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b83ca-ab6b-482e-9407-d483913f4844 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:52.413917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1198/2422] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:30:52.418191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603889-a08e-44a9-9ef3-0f8f9b60dd9b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:52.428411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603889-a08e-44a9-9ef3-0f8f9b60dd9b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:52.433500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686cbc-b980-45e2-bed3-235008f8bcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:52.434115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686cbc-b980-45e2-bed3-235008f8bcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:52.434634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686cbc-b980-45e2-bed3-235008f8bcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:52.434904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686cbc-b980-45e2-bed3-235008f8bcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:52.435889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686cbc-b980-45e2-bed3-235008f8bcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:52.437478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686cbc-b980-45e2-bed3-235008f8bcf8 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:52.450365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1225/2423] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:30:52.453876 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b83ca-ab6b-482e-9407-d483913f4844 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:52.465293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b83ca-ab6b-482e-9407-d483913f4844 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:52.471761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068bfe-d0d5-4809-a1e4-a8027e1a9b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:52.472588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068bfe-d0d5-4809-a1e4-a8027e1a9b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:52.473223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068bfe-d0d5-4809-a1e4-a8027e1a9b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:52.473619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068bfe-d0d5-4809-a1e4-a8027e1a9b99 admin admin] PATH_INFO: `/v3/projects/290c5e886bf64e989f2be4b94a570e3f/users/fd2797b8820c41a2ae939fd7c473a549/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:52.495008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686cbc-b980-45e2-bed3-235008f8bcf8 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:52.496879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068bfe-d0d5-4809-a1e4-a8027e1a9b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290c5e886bf64e989f2be4b94a570e3f, user_id=fd2797b8820c41a2ae939fd7c473a549, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:52.497087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2a686cbc-b980-45e2-bed3-235008f8bcf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:52.500148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068bfe-d0d5-4809-a1e4-a8027e1a9b99 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:52.514477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:52.562666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686cbc-b980-45e2-bed3-235008f8bcf8 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:52.566233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8762b-2280-46a0-bd2c-d8e00f1cd00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:52.566868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8762b-2280-46a0-bd2c-d8e00f1cd00c service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:52.567144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8762b-2280-46a0-bd2c-d8e00f1cd00c service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:52.567414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8762b-2280-46a0-bd2c-d8e00f1cd00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:52.569663 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-11a8762b-2280-46a0-bd2c-d8e00f1cd00c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:52.579314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8762b-2280-46a0-bd2c-d8e00f1cd00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:52.580759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8762b-2280-46a0-bd2c-d8e00f1cd00c service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:52.589872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1226/2424] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:30:52.610851 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1199/2425] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:30:52 2022] PUT /identity/v3/projects/290c5e886bf64e989f2be4b94a570e3f/users/fd2797b8820c41a2ae939fd7c473a549/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:30:52.615768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba38a9-c0ec-4da5-96b5-803fe4e45dd1 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:52.616188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba38a9-c0ec-4da5-96b5-803fe4e45dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:52.616561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba38a9-c0ec-4da5-96b5-803fe4e45dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:52.637494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-84ba38a9-c0ec-4da5-96b5-803fe4e45dd1 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:30:52.638930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-84ba38a9-c0ec-4da5-96b5-803fe4e45dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:52.707925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1227/2426] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:30:52.718351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068bfe-d0d5-4809-a1e4-a8027e1a9b99 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:52.720293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ca068bfe-d0d5-4809-a1e4-a8027e1a9b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:52.803472 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068bfe-d0d5-4809-a1e4-a8027e1a9b99 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:52.808056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c57fdd-4665-4f9b-9c81-b122c60a8787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:52.808938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c57fdd-4665-4f9b-9c81-b122c60a8787 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:52.809262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c57fdd-4665-4f9b-9c81-b122c60a8787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:52.809489 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c57fdd-4665-4f9b-9c81-b122c60a8787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:52.821803 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c57fdd-4665-4f9b-9c81-b122c60a8787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:52.823420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c57fdd-4665-4f9b-9c81-b122c60a8787 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:52.834491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1200/2427] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:55.505737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc235a48-9d0b-4e11-b028-436ab43cc58e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:55.510170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc235a48-9d0b-4e11-b028-436ab43cc58e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:55.510750 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc235a48-9d0b-4e11-b028-436ab43cc58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:55.541501 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-fc235a48-9d0b-4e11-b028-436ab43cc58e None None] MFA Rules not processed for user `5af2248451d3483d9742887d614a5077`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:30:55.543257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-fc235a48-9d0b-4e11-b028-436ab43cc58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:55.622685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1228/2428] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:30:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:30:59.049834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea38c-a471-4336-98cc-b4ee16050498 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:59.050452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea38c-a471-4336-98cc-b4ee16050498 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:59.050556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea38c-a471-4336-98cc-b4ee16050498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:59.102092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-253ea38c-a471-4336-98cc-b4ee16050498 None None] MFA Rules not processed for user `fd2797b8820c41a2ae939fd7c473a549`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:30:59.103533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-253ea38c-a471-4336-98cc-b4ee16050498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:59.296366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1201/2429] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:30:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:30:59.309884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc235a48-9d0b-4e11-b028-436ab43cc58e None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:59.311531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-fc235a48-9d0b-4e11-b028-436ab43cc58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:59.386711 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:59.412075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc235a48-9d0b-4e11-b028-436ab43cc58e None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:59.421361 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b087704-1fca-4509-ae2b-9eaba98b202c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:59.422154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b087704-1fca-4509-ae2b-9eaba98b202c service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:59.422566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b087704-1fca-4509-ae2b-9eaba98b202c service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:59.422944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b087704-1fca-4509-ae2b-9eaba98b202c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:59.436338 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b087704-1fca-4509-ae2b-9eaba98b202c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:59.437981 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b087704-1fca-4509-ae2b-9eaba98b202c service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:59.461089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1229/2430] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:30:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:31:02.537215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ea38c-a471-4336-98cc-b4ee16050498 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:31:02.540233 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-253ea38c-a471-4336-98cc-b4ee16050498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:31:02.564939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ea38c-a471-4336-98cc-b4ee16050498 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:31:02.571121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22127b7-7873-444b-bbea-87ba5ad54185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:31:02.571840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22127b7-7873-444b-bbea-87ba5ad54185 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:31:02.572106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22127b7-7873-444b-bbea-87ba5ad54185 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:31:02.572735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22127b7-7873-444b-bbea-87ba5ad54185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:31:02.575530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c22127b7-7873-444b-bbea-87ba5ad54185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:31:02.591301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22127b7-7873-444b-bbea-87ba5ad54185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:31:02.593120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22127b7-7873-444b-bbea-87ba5ad54185 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:31:02.606247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1202/2431] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:31:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:31:03.842675 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d3b17-5350-4bec-a96c-95a69ec18c96 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:31:03.843804 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d3b17-5350-4bec-a96c-95a69ec18c96 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:31:03.844311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d3b17-5350-4bec-a96c-95a69ec18c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:31:03.877923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f59d3b17-5350-4bec-a96c-95a69ec18c96 None None] MFA Rules not processed for user `fd2797b8820c41a2ae939fd7c473a549`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:31:03.877923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f59d3b17-5350-4bec-a96c-95a69ec18c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:31:03.882595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1230/2432] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:31:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:31:12.600175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:13.859691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=9 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:03.880561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22127b7-7873-444b-bbea-87ba5ad54185 service nova] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:03.892147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22127b7-7873-444b-bbea-87ba5ad54185 service nova] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:03.898638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910d530-1f8e-446f-9c52-52c2041c4ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:03.899307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910d530-1f8e-446f-9c52-52c2041c4ab7 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:03.899588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910d530-1f8e-446f-9c52-52c2041c4ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:03.899864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910d530-1f8e-446f-9c52-52c2041c4ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:03.902576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5910d530-1f8e-446f-9c52-52c2041c4ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:03.962459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910d530-1f8e-446f-9c52-52c2041c4ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:03.963960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910d530-1f8e-446f-9c52-52c2041c4ab7 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:03.973376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1203/2433] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:10.124261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d3b17-5350-4bec-a96c-95a69ec18c96 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:10.125908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f59d3b17-5350-4bec-a96c-95a69ec18c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:10.143536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d3b17-5350-4bec-a96c-95a69ec18c96 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:10.144714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:10.145353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:10.145629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:10.145898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] PATH_INFO: `/v3/users/5af2248451d3483d9742887d614a5077` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:10.147109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af2248451d3483d9742887d614a5077)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:10.149007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:10.359691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af2248451d3483d9742887d614a5077'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:10.360778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af2248451d3483d9742887d614a5077'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:10.368056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af2248451d3483d9742887d614a5077'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:10.381376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af2248451d3483d9742887d614a5077'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:10.452184 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-789044bb-c2d7-442d-9c00-608f1e49bb17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af2248451d3483d9742887d614a5077'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:10.459775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1231/2434] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:32:10 2022] DELETE /identity/v3/users/5af2248451d3483d9742887d614a5077 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:10.702350 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910d530-1f8e-446f-9c52-52c2041c4ab7 service nova] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:10.721992 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910d530-1f8e-446f-9c52-52c2041c4ab7 service nova] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:10.791307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:10.791953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:10.792237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:10.792521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] PATH_INFO: `/v3/projects/520d3d5e2e804be1bd5dc9bfc50c5de8` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:10.793678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] RBAC: Authorizing `identity:delete_project(project_id=520d3d5e2e804be1bd5dc9bfc50c5de8)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:10.795657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:10.934546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'request_id': 'req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:10.959737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'request_id': 'req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:11.031225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'request_id': 'req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:11.043468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] The token cache is being invalidate because project 520d3d5e2e804be1bd5dc9bfc50c5de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:32:11.043722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:11.045029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:11.047075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1204/2435] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:32:10 2022] DELETE /identity/v3/projects/520d3d5e2e804be1bd5dc9bfc50c5de8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:20.455838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:21.039794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:29.808428 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f17f8-35dc-481b-ac91-a86e06bc88d3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:29.812413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f17f8-35dc-481b-ac91-a86e06bc88d3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:29.812413 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f17f8-35dc-481b-ac91-a86e06bc88d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:29.831117 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-074f17f8-35dc-481b-ac91-a86e06bc88d3 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:29.831860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-074f17f8-35dc-481b-ac91-a86e06bc88d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:29.894872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1232/2436] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:32:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:30.031708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:30.035874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:30.111065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2aa2db-f3b9-4e38-b728-7937ba0ec62f admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:30.116734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58455f9-d1a9-4e6e-b66a-ae7f859d2658 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:30.117647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58455f9-d1a9-4e6e-b66a-ae7f859d2658 service swift] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:30.117647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58455f9-d1a9-4e6e-b66a-ae7f859d2658 service swift] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:30.131619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58455f9-d1a9-4e6e-b66a-ae7f859d2658 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:30.131619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58455f9-d1a9-4e6e-b66a-ae7f859d2658 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:30.131619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58455f9-d1a9-4e6e-b66a-ae7f859d2658 service swift] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:30.145798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1205/2437] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:32:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:37.871563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f17f8-35dc-481b-ac91-a86e06bc88d3 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:37.873732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-074f17f8-35dc-481b-ac91-a86e06bc88d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:37.961107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f17f8-35dc-481b-ac91-a86e06bc88d3 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:37.964741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f10080-2d03-4d76-a70a-cb1af7bd7617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:37.965368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f10080-2d03-4d76-a70a-cb1af7bd7617 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:37.965800 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f10080-2d03-4d76-a70a-cb1af7bd7617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:37.966081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f10080-2d03-4d76-a70a-cb1af7bd7617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:37.967918 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-23f10080-2d03-4d76-a70a-cb1af7bd7617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:38.094680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f10080-2d03-4d76-a70a-cb1af7bd7617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:38.097040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f10080-2d03-4d76-a70a-cb1af7bd7617 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:38.120448 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1233/2438] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:40.140633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=32 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:41.483407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58455f9-d1a9-4e6e-b66a-ae7f859d2658 service swift] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:41.484890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c58455f9-d1a9-4e6e-b66a-ae7f859d2658 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:41.499262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58455f9-d1a9-4e6e-b66a-ae7f859d2658 service swift] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:41.504701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656b1f9-3b69-46a3-a51d-c48ecfc978b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:41.505336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b1f9-3b69-46a3-a51d-c48ecfc978b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:41.505607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b1f9-3b69-46a3-a51d-c48ecfc978b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:41.505874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b1f9-3b69-46a3-a51d-c48ecfc978b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:41.507827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6656b1f9-3b69-46a3-a51d-c48ecfc978b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:41.619940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656b1f9-3b69-46a3-a51d-c48ecfc978b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:41.621459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656b1f9-3b69-46a3-a51d-c48ecfc978b5 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:41.637479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1206/2439] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:32:45.842830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f10080-2d03-4d76-a70a-cb1af7bd7617 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:45.844317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-23f10080-2d03-4d76-a70a-cb1af7bd7617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:45.914371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:45.920260 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f10080-2d03-4d76-a70a-cb1af7bd7617 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:45.925500 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789b761-40a0-45ec-b6b2-0a20fb1bdba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:45.926104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789b761-40a0-45ec-b6b2-0a20fb1bdba2 service placement] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:45.926406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789b761-40a0-45ec-b6b2-0a20fb1bdba2 service placement] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:45.926676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789b761-40a0-45ec-b6b2-0a20fb1bdba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:45.928385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a789b761-40a0-45ec-b6b2-0a20fb1bdba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:45.941000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789b761-40a0-45ec-b6b2-0a20fb1bdba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:45.942671 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789b761-40a0-45ec-b6b2-0a20fb1bdba2 service placement] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:45.952734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1234/2440] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:45.978416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656b1f9-3b69-46a3-a51d-c48ecfc978b5 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:45.979864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-6656b1f9-3b69-46a3-a51d-c48ecfc978b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:46.002488 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656b1f9-3b69-46a3-a51d-c48ecfc978b5 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:46.004052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:46.004688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:46.004965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:46.005236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] PATH_INFO: `/v3/users/9cb49b631c234f9a9fd47049b9b2e097` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:46.006569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb49b631c234f9a9fd47049b9b2e097)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:46.008481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:46.177065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb49b631c234f9a9fd47049b9b2e097'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:46.178062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb49b631c234f9a9fd47049b9b2e097'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:46.186023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb49b631c234f9a9fd47049b9b2e097'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:46.186972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb49b631c234f9a9fd47049b9b2e097'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:46.259591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-506b22dd-0b83-420d-9d9a-f0df9b786ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb49b631c234f9a9fd47049b9b2e097'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:46.285257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1207/2441] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:32:45 2022] DELETE /identity/v3/users/9cb49b631c234f9a9fd47049b9b2e097 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:46.539911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789b761-40a0-45ec-b6b2-0a20fb1bdba2 service placement] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:46.568255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789b761-40a0-45ec-b6b2-0a20fb1bdba2 service placement] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:46.649210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:46.649854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:46.650132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:46.650436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] PATH_INFO: `/v3/projects/faead990837d43de8ec54bfaf24361de` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:46.651602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faead990837d43de8ec54bfaf24361de)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:46.653969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:46.787879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faead990837d43de8ec54bfaf24361de', 'request_id': 'req-55069702-5cab-47aa-b996-4abc9e3723c8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:46.794677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faead990837d43de8ec54bfaf24361de', 'request_id': 'req-55069702-5cab-47aa-b996-4abc9e3723c8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:46.899195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faead990837d43de8ec54bfaf24361de', 'request_id': 'req-55069702-5cab-47aa-b996-4abc9e3723c8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:46.915115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] The token cache is being invalidate because project faead990837d43de8ec54bfaf24361de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:32:46.915540 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:46.916341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-55069702-5cab-47aa-b996-4abc9e3723c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:46.918072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1235/2442] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:32:46 2022] DELETE /identity/v3/projects/faead990837d43de8ec54bfaf24361de => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:46.924052 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe4c5e-97ca-4d20-a14b-c8d98f7c1d54 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:46.924365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe4c5e-97ca-4d20-a14b-c8d98f7c1d54 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:46.924710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe4c5e-97ca-4d20-a14b-c8d98f7c1d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:46.945504 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-0bbe4c5e-97ca-4d20-a14b-c8d98f7c1d54 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:46.946805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0bbe4c5e-97ca-4d20-a14b-c8d98f7c1d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:47.008898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1208/2443] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:47.016527 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dd1f9-2e50-4137-93f7-a680c74efa27 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:47.017350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dd1f9-2e50-4137-93f7-a680c74efa27 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:47.018059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dd1f9-2e50-4137-93f7-a680c74efa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:47.040492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-091dd1f9-2e50-4137-93f7-a680c74efa27 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:47.041932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-091dd1f9-2e50-4137-93f7-a680c74efa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:47.052121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1236/2444] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:47.056464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe4c5e-97ca-4d20-a14b-c8d98f7c1d54 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:47.066492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe4c5e-97ca-4d20-a14b-c8d98f7c1d54 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:47.071247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24e15b-716f-4d41-9d4a-3bf648231866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:47.071958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24e15b-716f-4d41-9d4a-3bf648231866 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:47.072238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24e15b-716f-4d41-9d4a-3bf648231866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:47.072505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24e15b-716f-4d41-9d4a-3bf648231866 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:47.073215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24e15b-716f-4d41-9d4a-3bf648231866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:32:47.073508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24e15b-716f-4d41-9d4a-3bf648231866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:47.075160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24e15b-716f-4d41-9d4a-3bf648231866 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:47.076874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:47.092293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1209/2445] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:32:47.093704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091dd1f9-2e50-4137-93f7-a680c74efa27 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:47.105792 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091dd1f9-2e50-4137-93f7-a680c74efa27 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:47.110835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f865e-f3f7-4218-af73-3ab9ed53e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:47.111461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f865e-f3f7-4218-af73-3ab9ed53e941 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:47.111745 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f865e-f3f7-4218-af73-3ab9ed53e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:47.112016 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f865e-f3f7-4218-af73-3ab9ed53e941 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:47.112688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f865e-f3f7-4218-af73-3ab9ed53e941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:47.114757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f865e-f3f7-4218-af73-3ab9ed53e941 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:47.203824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1237/2446] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:32:47 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:47.209281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24e15b-716f-4d41-9d4a-3bf648231866 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:47.221275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24e15b-716f-4d41-9d4a-3bf648231866 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:47.291366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2caafe-050e-4cde-b34c-48690707a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:47.292164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2caafe-050e-4cde-b34c-48690707a44b admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:47.292459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2caafe-050e-4cde-b34c-48690707a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:47.292859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2caafe-050e-4cde-b34c-48690707a44b admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:47.293613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2caafe-050e-4cde-b34c-48690707a44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:47.296055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2caafe-050e-4cde-b34c-48690707a44b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:47.397614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1210/2447] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:32:47 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:47.401790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f865e-f3f7-4218-af73-3ab9ed53e941 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:47.412542 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f865e-f3f7-4218-af73-3ab9ed53e941 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:47.417114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6ea0f-6356-4521-8d22-a3f7813ca865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:47.417680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6ea0f-6356-4521-8d22-a3f7813ca865 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:47.417957 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6ea0f-6356-4521-8d22-a3f7813ca865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:47.418230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6ea0f-6356-4521-8d22-a3f7813ca865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:47.418948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6ea0f-6356-4521-8d22-a3f7813ca865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:47.420527 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6ea0f-6356-4521-8d22-a3f7813ca865 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:47.430485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1238/2448] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:47.434553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2caafe-050e-4cde-b34c-48690707a44b admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:47.445010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2caafe-050e-4cde-b34c-48690707a44b admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:47.449950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99fb91-eeaf-40e6-a45a-d5098dda51cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:47.450945 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99fb91-eeaf-40e6-a45a-d5098dda51cc admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:47.451222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99fb91-eeaf-40e6-a45a-d5098dda51cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:47.451492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99fb91-eeaf-40e6-a45a-d5098dda51cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:47.452181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99fb91-eeaf-40e6-a45a-d5098dda51cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:47.453807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99fb91-eeaf-40e6-a45a-d5098dda51cc admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:47.465886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1211/2449] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:47.471150 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6ea0f-6356-4521-8d22-a3f7813ca865 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:47.481611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6ea0f-6356-4521-8d22-a3f7813ca865 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:47.487513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f16689-228d-4c73-ba3f-82f3c4275d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:47.488379 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f16689-228d-4c73-ba3f-82f3c4275d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:47.488729 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f16689-228d-4c73-ba3f-82f3c4275d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:47.489072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f16689-228d-4c73-ba3f-82f3c4275d0d admin admin] PATH_INFO: `/v3/projects/a89ad700f80542beb03f216e9e51b6c4/users/9645255aa18b44a3952008e812b34360/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:47.507587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f16689-228d-4c73-ba3f-82f3c4275d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a89ad700f80542beb03f216e9e51b6c4, user_id=9645255aa18b44a3952008e812b34360, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:47.510571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f16689-228d-4c73-ba3f-82f3c4275d0d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:47.587933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1239/2450] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:32:47 2022] PUT /identity/v3/projects/a89ad700f80542beb03f216e9e51b6c4/users/9645255aa18b44a3952008e812b34360/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:47.603720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a3a26-4ee6-4a60-8acc-dfae289ebb12 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:47.604009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a3a26-4ee6-4a60-8acc-dfae289ebb12 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:47.604283 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a3a26-4ee6-4a60-8acc-dfae289ebb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:47.611391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f16689-228d-4c73-ba3f-82f3c4275d0d admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:47.615124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-66f16689-228d-4c73-ba3f-82f3c4275d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:47.642057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:47.645542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d30a3a26-4ee6-4a60-8acc-dfae289ebb12 None None] MFA Rules not processed for user `9645255aa18b44a3952008e812b34360`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:47.647334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d30a3a26-4ee6-4a60-8acc-dfae289ebb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:47.690533 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f16689-228d-4c73-ba3f-82f3c4275d0d admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:47.694287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdca8f4-eaf4-40cb-b2a9-638642f3e212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:47.694925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdca8f4-eaf4-40cb-b2a9-638642f3e212 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:47.695198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdca8f4-eaf4-40cb-b2a9-638642f3e212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:47.695474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdca8f4-eaf4-40cb-b2a9-638642f3e212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:47.697290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5bdca8f4-eaf4-40cb-b2a9-638642f3e212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:47.733686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1212/2451] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:47.745987 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a3a26-4ee6-4a60-8acc-dfae289ebb12 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:47.747426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d30a3a26-4ee6-4a60-8acc-dfae289ebb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:47.772797 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdca8f4-eaf4-40cb-b2a9-638642f3e212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:47.774230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdca8f4-eaf4-40cb-b2a9-638642f3e212 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:47.786230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1240/2452] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:47.810859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:47.828813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a3a26-4ee6-4a60-8acc-dfae289ebb12 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:47.835339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cdd9b-625e-474e-b203-9f185b7f115a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:47.841362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cdd9b-625e-474e-b203-9f185b7f115a service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:47.841362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cdd9b-625e-474e-b203-9f185b7f115a service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:47.841362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cdd9b-625e-474e-b203-9f185b7f115a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:47.845467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cdd9b-625e-474e-b203-9f185b7f115a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:47.847270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cdd9b-625e-474e-b203-9f185b7f115a service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:47.857074 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1213/2453] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:32:48.139788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdca8f4-eaf4-40cb-b2a9-638642f3e212 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:48.151556 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdca8f4-eaf4-40cb-b2a9-638642f3e212 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:48.156945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:48.158142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:48.158447 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:48.158820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] PATH_INFO: `/v3/users/9645255aa18b44a3952008e812b34360` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:48.160334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9645255aa18b44a3952008e812b34360)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:48.162557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:48.434207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9645255aa18b44a3952008e812b34360'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:48.434978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9645255aa18b44a3952008e812b34360'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:48.443271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9645255aa18b44a3952008e812b34360'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:48.456634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9645255aa18b44a3952008e812b34360'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:48.545471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9645255aa18b44a3952008e812b34360'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:48.557283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1241/2454] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:32:48 2022] DELETE /identity/v3/users/9645255aa18b44a3952008e812b34360 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:48.561696 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f43d32-772c-4d75-8730-6dcff93f8a3e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:48.562183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f43d32-772c-4d75-8730-6dcff93f8a3e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:48.562280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f43d32-772c-4d75-8730-6dcff93f8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:48.584033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-45f43d32-772c-4d75-8730-6dcff93f8a3e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:48.585232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-45f43d32-772c-4d75-8730-6dcff93f8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:48.651530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1214/2455] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:48.666267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:48.667948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:48.672080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1f8d-7cf8-44d4-8b64-dafdcc114386 None None] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:48.672525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1f8d-7cf8-44d4-8b64-dafdcc114386 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:48.673015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1f8d-7cf8-44d4-8b64-dafdcc114386 None None] PATH_INFO: `/` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:48.675111 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1215/2456] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:32:48.684511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6878c5-f90c-47d5-b5f3-2ef9284cd780 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:48.685084 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6878c5-f90c-47d5-b5f3-2ef9284cd780 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:48.685518 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6878c5-f90c-47d5-b5f3-2ef9284cd780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:48.708372 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-af6878c5-f90c-47d5-b5f3-2ef9284cd780 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:48.709764 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-af6878c5-f90c-47d5-b5f3-2ef9284cd780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:48.719313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:48.740452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c346-956c-4637-b065-241b0391096b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:48.745070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6a9a2-a586-458d-823b-9066875c1fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:48.745838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6a9a2-a586-458d-823b-9066875c1fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:48.746348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6a9a2-a586-458d-823b-9066875c1fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:48.746728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6a9a2-a586-458d-823b-9066875c1fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:48.759691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6a9a2-a586-458d-823b-9066875c1fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:48.761875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6a9a2-a586-458d-823b-9066875c1fc4 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:48.776986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1242/2457] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:48.787880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1216/2458] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:32:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:32:48.803058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6a9a2-a586-458d-823b-9066875c1fc4 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:48.804901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5db6a9a2-a586-458d-823b-9066875c1fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:48.874021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6a9a2-a586-458d-823b-9066875c1fc4 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:48.879038 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0165bb-3eab-4119-8e4f-f54c4c8f6b0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc9a884f16149cda246ea9638621296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:48.879669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0165bb-3eab-4119-8e4f-f54c4c8f6b0c service glance] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:48.879946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0165bb-3eab-4119-8e4f-f54c4c8f6b0c service glance] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:48.880473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0165bb-3eab-4119-8e4f-f54c4c8f6b0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:48.891253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0165bb-3eab-4119-8e4f-f54c4c8f6b0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:48.893529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0165bb-3eab-4119-8e4f-f54c4c8f6b0c service glance] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:48.907546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1243/2459] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:49.066973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6878c5-f90c-47d5-b5f3-2ef9284cd780 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:49.076925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6878c5-f90c-47d5-b5f3-2ef9284cd780 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:49.080936 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9c7b8-5943-4640-ab7f-ddf351071b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:49.081673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9c7b8-5943-4640-ab7f-ddf351071b7c service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.082021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9c7b8-5943-4640-ab7f-ddf351071b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.082396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9c7b8-5943-4640-ab7f-ddf351071b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.084250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e6e9c7b8-5943-4640-ab7f-ddf351071b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:49.098558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9c7b8-5943-4640-ab7f-ddf351071b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:49.100092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9c7b8-5943-4640-ab7f-ddf351071b7c service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:49.111056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1217/2460] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:49.142265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41845f48-84d6-41c6-9288-a187cd7f8dfb None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.142983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41845f48-84d6-41c6-9288-a187cd7f8dfb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.142983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41845f48-84d6-41c6-9288-a187cd7f8dfb None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.144540 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1244/2461] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:32:49.151644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02510c-59fe-4bef-9f5c-d662add284de None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.151969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02510c-59fe-4bef-9f5c-d662add284de None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.152234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02510c-59fe-4bef-9f5c-d662add284de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.183903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-0f02510c-59fe-4bef-9f5c-d662add284de None None] MFA Rules not processed for user `4213a478acfe4cc88df41b3da2d581ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:49.185378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0f02510c-59fe-4bef-9f5c-d662add284de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:49.199022 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1218/2462] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:49.208920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41845f48-84d6-41c6-9288-a187cd7f8dfb None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:49.222586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41845f48-84d6-41c6-9288-a187cd7f8dfb None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:49.227055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383be1ff-ab5a-486c-b308-ee289e0df7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:49.227683 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383be1ff-ab5a-486c-b308-ee289e0df7fa service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.228169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383be1ff-ab5a-486c-b308-ee289e0df7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.228609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383be1ff-ab5a-486c-b308-ee289e0df7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.239144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383be1ff-ab5a-486c-b308-ee289e0df7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:49.244649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383be1ff-ab5a-486c-b308-ee289e0df7fa service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:49.250896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1245/2463] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:32:49.354125 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02510c-59fe-4bef-9f5c-d662add284de None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:49.354863 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0f02510c-59fe-4bef-9f5c-d662add284de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:49.393979 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02510c-59fe-4bef-9f5c-d662add284de None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:49.399786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:49.400580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.400925 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.401265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] PATH_INFO: `/v3/projects/a89ad700f80542beb03f216e9e51b6c4` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.402689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a89ad700f80542beb03f216e9e51b6c4)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:49.405355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a0fc-5b55-45f3-bce5-a72534e3ce98 None None] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.405355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a0fc-5b55-45f3-bce5-a72534e3ce98 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.405757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:49.405859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a0fc-5b55-45f3-bce5-a72534e3ce98 None None] PATH_INFO: `/` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.407999 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1246/2464] 10.222.0.46 () {54 vars in 921 bytes} [Thu Aug 4 05:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:32:49.415156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b77e8-9f3c-4f33-af38-1315a458e8c4 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.415521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b77e8-9f3c-4f33-af38-1315a458e8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.415859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b77e8-9f3c-4f33-af38-1315a458e8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.469010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-797b77e8-9f3c-4f33-af38-1315a458e8c4 None None] MFA Rules not processed for user `27f7331502484928ba7f8a4b403bdddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:49.471727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-797b77e8-9f3c-4f33-af38-1315a458e8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:49.487930 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1247/2465] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Aug 4 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:49.501788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b77e8-9f3c-4f33-af38-1315a458e8c4 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:49.514365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b77e8-9f3c-4f33-af38-1315a458e8c4 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:49.522490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36c3c8-a29f-4d4a-9edc-bebe13f50e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:49.523691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36c3c8-a29f-4d4a-9edc-bebe13f50e35 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.524267 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36c3c8-a29f-4d4a-9edc-bebe13f50e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.524698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36c3c8-a29f-4d4a-9edc-bebe13f50e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.541358 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36c3c8-a29f-4d4a-9edc-bebe13f50e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:49.543166 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36c3c8-a29f-4d4a-9edc-bebe13f50e35 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:49.569739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1248/2466] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:49.620053 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a89ad700f80542beb03f216e9e51b6c4', 'request_id': 'req-5449c661-6d6b-4f5e-98e8-802dce147d76'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:49.628978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a89ad700f80542beb03f216e9e51b6c4', 'request_id': 'req-5449c661-6d6b-4f5e-98e8-802dce147d76'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:49.630931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:49.714293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a89ad700f80542beb03f216e9e51b6c4', 'request_id': 'req-5449c661-6d6b-4f5e-98e8-802dce147d76'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:49.728608 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] The token cache is being invalidate because project a89ad700f80542beb03f216e9e51b6c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:32:49.729234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:49.730211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-5449c661-6d6b-4f5e-98e8-802dce147d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:49.732331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1219/2467] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:32:49 2022] DELETE /identity/v3/projects/a89ad700f80542beb03f216e9e51b6c4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:49.737830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b8b5-a237-4983-b3c1-e68d9f135437 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.738337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b8b5-a237-4983-b3c1-e68d9f135437 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.738650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b8b5-a237-4983-b3c1-e68d9f135437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.770212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3275b8b5-a237-4983-b3c1-e68d9f135437 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:49.772074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3275b8b5-a237-4983-b3c1-e68d9f135437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:49.866507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1249/2468] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:49.869148 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f279b2-e91c-4ff3-a552-05cf28d68087 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.869341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f279b2-e91c-4ff3-a552-05cf28d68087 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.869622 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f279b2-e91c-4ff3-a552-05cf28d68087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.893606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b5f279b2-e91c-4ff3-a552-05cf28d68087 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:49.894978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b5f279b2-e91c-4ff3-a552-05cf28d68087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:49.904988 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1220/2469] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:49.909536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b8b5-a237-4983-b3c1-e68d9f135437 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:49.920334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b8b5-a237-4983-b3c1-e68d9f135437 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:49.926056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24306d04-6ffa-4724-bd25-2003442f2ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:49.926849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24306d04-6ffa-4724-bd25-2003442f2ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.927129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24306d04-6ffa-4724-bd25-2003442f2ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.927404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24306d04-6ffa-4724-bd25-2003442f2ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.928111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24306d04-6ffa-4724-bd25-2003442f2ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:32:49.928411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24306d04-6ffa-4724-bd25-2003442f2ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:49.930787 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24306d04-6ffa-4724-bd25-2003442f2ed8 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:49.948102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1250/2470] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:32:49.953328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f279b2-e91c-4ff3-a552-05cf28d68087 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:49.966293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f279b2-e91c-4ff3-a552-05cf28d68087 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:49.971214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc3ab4-edbc-4275-894f-915f712b3aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:49.971556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc3ab4-edbc-4275-894f-915f712b3aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:49.971811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc3ab4-edbc-4275-894f-915f712b3aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:49.972089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc3ab4-edbc-4275-894f-915f712b3aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:49.972767 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc3ab4-edbc-4275-894f-915f712b3aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:49.974888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc3ab4-edbc-4275-894f-915f712b3aa4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:50.073880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1221/2471] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:32:49 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:32:50.078242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24306d04-6ffa-4724-bd25-2003442f2ed8 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:50.089602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24306d04-6ffa-4724-bd25-2003442f2ed8 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:50.153114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:50.186490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d090892-d725-4967-8cd2-50c65aeead63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:50.187174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d090892-d725-4967-8cd2-50c65aeead63 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:50.187629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d090892-d725-4967-8cd2-50c65aeead63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:50.187903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d090892-d725-4967-8cd2-50c65aeead63 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:50.189724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d090892-d725-4967-8cd2-50c65aeead63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:50.192587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d090892-d725-4967-8cd2-50c65aeead63 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:50.266351 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1251/2472] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:32:50 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:32:50.271631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc3ab4-edbc-4275-894f-915f712b3aa4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:50.286237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc3ab4-edbc-4275-894f-915f712b3aa4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:50.294552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7c1c7-8deb-4e62-8647-89d703a65058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:50.295891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c1c7-8deb-4e62-8647-89d703a65058 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:50.296507 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c1c7-8deb-4e62-8647-89d703a65058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:50.297139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c1c7-8deb-4e62-8647-89d703a65058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:50.299335 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7c1c7-8deb-4e62-8647-89d703a65058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:50.302899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7c1c7-8deb-4e62-8647-89d703a65058 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:50.318230 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1222/2473] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:50.323020 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d090892-d725-4967-8cd2-50c65aeead63 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:50.336294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d090892-d725-4967-8cd2-50c65aeead63 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:50.341789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89880b80-d1cf-4d7c-8801-a45cd952b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:50.342624 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89880b80-d1cf-4d7c-8801-a45cd952b6ab admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:50.343305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89880b80-d1cf-4d7c-8801-a45cd952b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:50.343744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89880b80-d1cf-4d7c-8801-a45cd952b6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:50.344610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89880b80-d1cf-4d7c-8801-a45cd952b6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:50.347165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89880b80-d1cf-4d7c-8801-a45cd952b6ab admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:50.365308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1252/2474] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:50.366670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7c1c7-8deb-4e62-8647-89d703a65058 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:50.389970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7c1c7-8deb-4e62-8647-89d703a65058 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:50.412896 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d619a0-a4f8-4cbd-adc1-fe52d7095111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:50.413746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d619a0-a4f8-4cbd-adc1-fe52d7095111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:50.414156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d619a0-a4f8-4cbd-adc1-fe52d7095111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:50.414771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d619a0-a4f8-4cbd-adc1-fe52d7095111 admin admin] PATH_INFO: `/v3/projects/8f510faffdec4e5e809dfdb11ffa98e4/users/92dbd76149264ddb8c3069a9c20b9c99/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:50.432202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d619a0-a4f8-4cbd-adc1-fe52d7095111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f510faffdec4e5e809dfdb11ffa98e4, user_id=92dbd76149264ddb8c3069a9c20b9c99, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:50.435081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d619a0-a4f8-4cbd-adc1-fe52d7095111 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:50.541376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1223/2475] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:32:50 2022] PUT /identity/v3/projects/8f510faffdec4e5e809dfdb11ffa98e4/users/92dbd76149264ddb8c3069a9c20b9c99/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:32:50.552567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb064a1-50d6-49ec-8b61-a90d75112028 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:50.552858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb064a1-50d6-49ec-8b61-a90d75112028 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:50.553157 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb064a1-50d6-49ec-8b61-a90d75112028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:50.591803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ccb064a1-50d6-49ec-8b61-a90d75112028 None None] MFA Rules not processed for user `92dbd76149264ddb8c3069a9c20b9c99`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:50.593434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ccb064a1-50d6-49ec-8b61-a90d75112028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:50.717389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1253/2476] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:50.717501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d619a0-a4f8-4cbd-adc1-fe52d7095111 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:50.811959 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d619a0-a4f8-4cbd-adc1-fe52d7095111 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:50.822742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f0ace-ba75-4440-bbc9-ef8d69d0936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:50.823430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f0ace-ba75-4440-bbc9-ef8d69d0936c admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:50.823759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f0ace-ba75-4440-bbc9-ef8d69d0936c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:50.824209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f0ace-ba75-4440-bbc9-ef8d69d0936c admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:50.825049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f0ace-ba75-4440-bbc9-ef8d69d0936c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:50.830466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f0ace-ba75-4440-bbc9-ef8d69d0936c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:50.925217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1224/2477] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:32:50 2022] POST /identity/v3/projects => generated 371 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:50.926935 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb064a1-50d6-49ec-8b61-a90d75112028 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:50.942736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb064a1-50d6-49ec-8b61-a90d75112028 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:51.025373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e199e-081c-4e39-a99b-142daaa0286b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:51.025990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e199e-081c-4e39-a99b-142daaa0286b admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:51.026263 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e199e-081c-4e39-a99b-142daaa0286b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:51.026559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e199e-081c-4e39-a99b-142daaa0286b admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:51.027226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e199e-081c-4e39-a99b-142daaa0286b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:51.029422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e199e-081c-4e39-a99b-142daaa0286b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:51.154003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1254/2478] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:32:50 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:32:51.159850 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f0ace-ba75-4440-bbc9-ef8d69d0936c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:51.175328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f0ace-ba75-4440-bbc9-ef8d69d0936c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:51.180953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23769b-2f34-40a7-be5d-e871bf7f76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:51.181588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23769b-2f34-40a7-be5d-e871bf7f76a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:51.181917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23769b-2f34-40a7-be5d-e871bf7f76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:51.182419 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23769b-2f34-40a7-be5d-e871bf7f76a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:51.184753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23769b-2f34-40a7-be5d-e871bf7f76a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:51.185029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23769b-2f34-40a7-be5d-e871bf7f76a1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:51.204294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1225/2479] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:51.212112 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e199e-081c-4e39-a99b-142daaa0286b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:51.224356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e199e-081c-4e39-a99b-142daaa0286b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:51.230354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54a62b-046f-4a6c-bd62-d885d796b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:51.231487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54a62b-046f-4a6c-bd62-d885d796b419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:51.231864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54a62b-046f-4a6c-bd62-d885d796b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:51.232241 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54a62b-046f-4a6c-bd62-d885d796b419 admin admin] PATH_INFO: `/v3/projects/1558e1460de644f3a173e839e43bf284/users/4f12062441824350a6613200e7a3ea52/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:51.253506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54a62b-046f-4a6c-bd62-d885d796b419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1558e1460de644f3a173e839e43bf284, user_id=4f12062441824350a6613200e7a3ea52, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:51.256455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54a62b-046f-4a6c-bd62-d885d796b419 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:51.361327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1255/2480] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:32:51 2022] PUT /identity/v3/projects/1558e1460de644f3a173e839e43bf284/users/4f12062441824350a6613200e7a3ea52/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:32:51.362737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23769b-2f34-40a7-be5d-e871bf7f76a1 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:51.391040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23769b-2f34-40a7-be5d-e871bf7f76a1 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:51.469491 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:51.481406 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5745f-5df2-4a99-9d80-15b752042ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:51.481675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5745f-5df2-4a99-9d80-15b752042ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:51.481906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5745f-5df2-4a99-9d80-15b752042ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:51.482264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5745f-5df2-4a99-9d80-15b752042ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:51.483478 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5745f-5df2-4a99-9d80-15b752042ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:51.486057 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5745f-5df2-4a99-9d80-15b752042ebf admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:51.511887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1226/2481] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:51.512651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54a62b-046f-4a6c-bd62-d885d796b419 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:51.527478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54a62b-046f-4a6c-bd62-d885d796b419 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:51.534420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437b73a-fa91-4de2-a935-f3b5c7741412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:51.535097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437b73a-fa91-4de2-a935-f3b5c7741412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:51.535372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437b73a-fa91-4de2-a935-f3b5c7741412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:51.535691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437b73a-fa91-4de2-a935-f3b5c7741412 admin admin] PATH_INFO: `/v3/projects/1558e1460de644f3a173e839e43bf284/users/4f12062441824350a6613200e7a3ea52/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:51.537749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437b73a-fa91-4de2-a935-f3b5c7741412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1558e1460de644f3a173e839e43bf284, user_id=4f12062441824350a6613200e7a3ea52, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:51.540524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437b73a-fa91-4de2-a935-f3b5c7741412 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:51.546589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:51.552377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1256/2482] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:32:51 2022] PUT /identity/v3/projects/1558e1460de644f3a173e839e43bf284/users/4f12062441824350a6613200e7a3ea52/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:51.562869 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f49c-7213-4a30-bcda-25291067c7ae None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:51.563153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f49c-7213-4a30-bcda-25291067c7ae None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:51.563477 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f49c-7213-4a30-bcda-25291067c7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:51.604235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-5476f49c-7213-4a30-bcda-25291067c7ae None None] MFA Rules not processed for user `4f12062441824350a6613200e7a3ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:51.604235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5476f49c-7213-4a30-bcda-25291067c7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:51.687935 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1227/2483] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:51.701522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437b73a-fa91-4de2-a935-f3b5c7741412 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:51.703700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d437b73a-fa91-4de2-a935-f3b5c7741412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:51.786052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437b73a-fa91-4de2-a935-f3b5c7741412 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:51.790947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c456-a8fe-4502-b606-8199442f1278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:51.793027 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c456-a8fe-4502-b606-8199442f1278 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:51.793486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c456-a8fe-4502-b606-8199442f1278 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:51.795506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c456-a8fe-4502-b606-8199442f1278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:51.804627 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c456-a8fe-4502-b606-8199442f1278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:51.806050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c456-a8fe-4502-b606-8199442f1278 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:51.817135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1257/2484] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:53.116971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476f49c-7213-4a30-bcda-25291067c7ae None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:53.240647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476f49c-7213-4a30-bcda-25291067c7ae None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:53.245770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:53.246596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:53.247060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:53.247711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] PATH_INFO: `/v3/users/92dbd76149264ddb8c3069a9c20b9c99` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:53.250354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] RBAC: Authorizing `identity:delete_user(user_id=92dbd76149264ddb8c3069a9c20b9c99)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:53.250924 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:53.459930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92dbd76149264ddb8c3069a9c20b9c99'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:53.460654 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92dbd76149264ddb8c3069a9c20b9c99'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:53.470572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92dbd76149264ddb8c3069a9c20b9c99'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:53.473917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92dbd76149264ddb8c3069a9c20b9c99'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:53.597045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92dbd76149264ddb8c3069a9c20b9c99'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:53.610827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:53.624755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1228/2485] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:32:53 2022] DELETE /identity/v3/users/92dbd76149264ddb8c3069a9c20b9c99 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:53.634793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88369a5-9015-433f-8f51-7c543489635a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:53.634793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88369a5-9015-433f-8f51-7c543489635a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:53.634793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88369a5-9015-433f-8f51-7c543489635a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:53.671521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-f88369a5-9015-433f-8f51-7c543489635a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:53.673111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f88369a5-9015-433f-8f51-7c543489635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:53.790983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1258/2486] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:53.838552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:53.840305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:53.922364 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d2171-f9af-4358-97e2-9dd06cac188e admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:53.930106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354f75-330c-4003-9bdf-3c32a786f724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:53.931070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354f75-330c-4003-9bdf-3c32a786f724 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:53.931454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354f75-330c-4003-9bdf-3c32a786f724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:53.931826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354f75-330c-4003-9bdf-3c32a786f724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:53.944538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19354f75-330c-4003-9bdf-3c32a786f724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:53.946535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19354f75-330c-4003-9bdf-3c32a786f724 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:53.960277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1229/2487] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:54.724475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88369a5-9015-433f-8f51-7c543489635a None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:54.726933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-f88369a5-9015-433f-8f51-7c543489635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:54.742237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88369a5-9015-433f-8f51-7c543489635a None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:54.749927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:54.750680 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:54.751570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:54.751986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] PATH_INFO: `/v3/projects/8f510faffdec4e5e809dfdb11ffa98e4` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:54.757893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f510faffdec4e5e809dfdb11ffa98e4)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:54.757893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:54.782704 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354f75-330c-4003-9bdf-3c32a786f724 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:54.784744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-19354f75-330c-4003-9bdf-3c32a786f724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:54.805598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354f75-330c-4003-9bdf-3c32a786f724 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:54.811155 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:54.811817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:54.812091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:54.812360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] PATH_INFO: `/v3/users/eb4dea95659c473b9b193c6234186430` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:54.814260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4dea95659c473b9b193c6234186430)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:54.817265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:54.883429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f510faffdec4e5e809dfdb11ffa98e4', 'request_id': 'req-10b07741-a878-4f5d-ba1d-ffc4e366e270'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:54.890583 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f510faffdec4e5e809dfdb11ffa98e4', 'request_id': 'req-10b07741-a878-4f5d-ba1d-ffc4e366e270'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:54.940237 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f510faffdec4e5e809dfdb11ffa98e4', 'request_id': 'req-10b07741-a878-4f5d-ba1d-ffc4e366e270'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:54.943960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4dea95659c473b9b193c6234186430'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:54.944639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4dea95659c473b9b193c6234186430'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:54.953587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4dea95659c473b9b193c6234186430'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:54.954923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4dea95659c473b9b193c6234186430'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:54.956988 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] The token cache is being invalidate because project 8f510faffdec4e5e809dfdb11ffa98e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:32:54.958253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:54.959601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-10b07741-a878-4f5d-ba1d-ffc4e366e270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:54.961809 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1259/2488] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:32:54 2022] DELETE /identity/v3/projects/8f510faffdec4e5e809dfdb11ffa98e4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:54.963234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672444d-2212-475b-b27e-92a68a71c292 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:54.963659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672444d-2212-475b-b27e-92a68a71c292 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:54.963944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672444d-2212-475b-b27e-92a68a71c292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:54.984430 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-1672444d-2212-475b-b27e-92a68a71c292 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:54.986283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1672444d-2212-475b-b27e-92a68a71c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:55.008663 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:55.019683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4dea95659c473b9b193c6234186430'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.045311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1230/2489] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:32:54 2022] DELETE /identity/v3/users/eb4dea95659c473b9b193c6234186430 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:55.045311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:55.045311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:55.068959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1260/2490] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:32:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:55.087656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672444d-2212-475b-b27e-92a68a71c292 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:55.089982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1672444d-2212-475b-b27e-92a68a71c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:55.191139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672444d-2212-475b-b27e-92a68a71c292 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:55.249119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2702e-f0e7-4548-986d-b40c60086899 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:55.261010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:55.261671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:55.262004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:55.262218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] PATH_INFO: `/v3/users/4f12062441824350a6613200e7a3ea52` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:55.263874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f12062441824350a6613200e7a3ea52)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:55.273297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:55.293521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:55.297346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3069eb-fef5-4987-ae46-aee25cd13e39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:55.297761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3069eb-fef5-4987-ae46-aee25cd13e39 service swift] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:55.298121 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3069eb-fef5-4987-ae46-aee25cd13e39 service swift] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:55.298575 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3069eb-fef5-4987-ae46-aee25cd13e39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:55.364250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3069eb-fef5-4987-ae46-aee25cd13e39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:55.365862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3069eb-fef5-4987-ae46-aee25cd13e39 service swift] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:55.375252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1261/2491] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:32:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:55.382594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3069eb-fef5-4987-ae46-aee25cd13e39 service swift] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:55.384315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ac3069eb-fef5-4987-ae46-aee25cd13e39 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:55.401958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3069eb-fef5-4987-ae46-aee25cd13e39 service swift] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:55.407299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:55.407949 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:55.408216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:55.408637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] PATH_INFO: `/v3/projects/d1ca4b83dc874bda9f33e06f4910608c` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:55.409843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ca4b83dc874bda9f33e06f4910608c)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:55.413559 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:55.425117 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:55.459371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f12062441824350a6613200e7a3ea52'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.460190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f12062441824350a6613200e7a3ea52'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.470172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f12062441824350a6613200e7a3ea52'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.470960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f12062441824350a6613200e7a3ea52'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.547248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0518effe-1a64-41e4-8f98-d9539756162b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f12062441824350a6613200e7a3ea52'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.572455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ca4b83dc874bda9f33e06f4910608c', 'request_id': 'req-c4d79ffc-5632-4342-9a53-276a70f6fe1d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.589317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ca4b83dc874bda9f33e06f4910608c', 'request_id': 'req-c4d79ffc-5632-4342-9a53-276a70f6fe1d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.595453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1231/2492] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:32:55 2022] DELETE /identity/v3/users/4f12062441824350a6613200e7a3ea52 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:55.687839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ca4b83dc874bda9f33e06f4910608c', 'request_id': 'req-c4d79ffc-5632-4342-9a53-276a70f6fe1d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.708690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] The token cache is being invalidate because project d1ca4b83dc874bda9f33e06f4910608c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:32:55.708904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.711611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c4d79ffc-5632-4342-9a53-276a70f6fe1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:55.716138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1262/2493] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:32:55 2022] DELETE /identity/v3/projects/d1ca4b83dc874bda9f33e06f4910608c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:32:55.721487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dabb42-fe76-481f-bbd7-07661241e299 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:55.722136 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dabb42-fe76-481f-bbd7-07661241e299 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:55.722778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dabb42-fe76-481f-bbd7-07661241e299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:55.759431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c5dabb42-fe76-481f-bbd7-07661241e299 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:55.764502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c5dabb42-fe76-481f-bbd7-07661241e299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:55.854942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1232/2494] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:55.863743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2f74-304c-4a8a-baea-caa0b9ad4335 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:55.864249 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2f74-304c-4a8a-baea-caa0b9ad4335 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:55.864334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2f74-304c-4a8a-baea-caa0b9ad4335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.070165 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-6aae2f74-304c-4a8a-baea-caa0b9ad4335 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:56.071220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6aae2f74-304c-4a8a-baea-caa0b9ad4335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:56.093143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1263/2495] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:56.096949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dabb42-fe76-481f-bbd7-07661241e299 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:56.107967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dabb42-fe76-481f-bbd7-07661241e299 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:56.127548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94969-57c5-4390-a535-0b8adf05bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:56.128582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94969-57c5-4390-a535-0b8adf05bed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.128582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94969-57c5-4390-a535-0b8adf05bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.128582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94969-57c5-4390-a535-0b8adf05bed7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.129657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94969-57c5-4390-a535-0b8adf05bed7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:32:56.129657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94969-57c5-4390-a535-0b8adf05bed7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:56.131280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94969-57c5-4390-a535-0b8adf05bed7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:56.160646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1233/2496] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:32:56.161390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae2f74-304c-4a8a-baea-caa0b9ad4335 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:56.184487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae2f74-304c-4a8a-baea-caa0b9ad4335 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:56.196254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c302f-acd0-4a15-bc4a-6232d4164060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:56.196884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c302f-acd0-4a15-bc4a-6232d4164060 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.197161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c302f-acd0-4a15-bc4a-6232d4164060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.197432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c302f-acd0-4a15-bc4a-6232d4164060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.198105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c302f-acd0-4a15-bc4a-6232d4164060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:56.200136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c302f-acd0-4a15-bc4a-6232d4164060 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:56.279316 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94969-57c5-4390-a535-0b8adf05bed7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:56.280975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-22f94969-57c5-4390-a535-0b8adf05bed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:56.317000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94969-57c5-4390-a535-0b8adf05bed7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:56.332320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:56.333027 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.333679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.333679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] PATH_INFO: `/v3/projects/1558e1460de644f3a173e839e43bf284` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.347629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1558e1460de644f3a173e839e43bf284)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:56.349607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:56.379759 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1264/2497] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:32:56 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:56.382775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c302f-acd0-4a15-bc4a-6232d4164060 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:56.511906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1558e1460de644f3a173e839e43bf284', 'request_id': 'req-12a73a23-b082-435b-9202-4487ea2d018b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:56.527379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1558e1460de644f3a173e839e43bf284', 'request_id': 'req-12a73a23-b082-435b-9202-4487ea2d018b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:56.541726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c302f-acd0-4a15-bc4a-6232d4164060 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:56.573466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1558e1460de644f3a173e839e43bf284', 'request_id': 'req-12a73a23-b082-435b-9202-4487ea2d018b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:56.581775 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:56.590029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] The token cache is being invalidate because project 1558e1460de644f3a173e839e43bf284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:32:56.590379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:56.593280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-12a73a23-b082-435b-9202-4487ea2d018b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:32:56.596920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1234/2498] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:32:56 2022] DELETE /identity/v3/projects/1558e1460de644f3a173e839e43bf284 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:32:56.602192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214c3e6-f0bb-49ce-9aeb-8749ff538ba5 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.602617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214c3e6-f0bb-49ce-9aeb-8749ff538ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.602808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214c3e6-f0bb-49ce-9aeb-8749ff538ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.659738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c214c3e6-f0bb-49ce-9aeb-8749ff538ba5 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:56.662272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c214c3e6-f0bb-49ce-9aeb-8749ff538ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:56.709566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2435ab-17ec-4105-9dd1-651f91b4425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:56.710602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2435ab-17ec-4105-9dd1-651f91b4425f admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.710898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2435ab-17ec-4105-9dd1-651f91b4425f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.711307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2435ab-17ec-4105-9dd1-651f91b4425f admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.713742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2435ab-17ec-4105-9dd1-651f91b4425f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:56.716040 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2435ab-17ec-4105-9dd1-651f91b4425f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:56.781941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1235/2499] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:32:56.791946 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b3eba-cec4-47b1-bbb0-419f75c9b4ae None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.792577 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b3eba-cec4-47b1-bbb0-419f75c9b4ae None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.793086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b3eba-cec4-47b1-bbb0-419f75c9b4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.819861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-df7b3eba-cec4-47b1-bbb0-419f75c9b4ae None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:56.826097 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-df7b3eba-cec4-47b1-bbb0-419f75c9b4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:56.833450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1265/2500] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:32:56 2022] POST /identity/v3/users => generated 292 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:56.839033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2435ab-17ec-4105-9dd1-651f91b4425f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:56.841255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3b2435ab-17ec-4105-9dd1-651f91b4425f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:56.858475 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:56.858602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1236/2501] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:56.862515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b3eba-cec4-47b1-bbb0-419f75c9b4ae None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:56.866273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2435ab-17ec-4105-9dd1-651f91b4425f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:56.872234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff1545-cb38-4a28-b80c-4080a6002c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:56.873115 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff1545-cb38-4a28-b80c-4080a6002c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.873596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff1545-cb38-4a28-b80c-4080a6002c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.874054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff1545-cb38-4a28-b80c-4080a6002c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.875091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff1545-cb38-4a28-b80c-4080a6002c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:56.877880 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff1545-cb38-4a28-b80c-4080a6002c73 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:56.883256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b3eba-cec4-47b1-bbb0-419f75c9b4ae None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:56.891319 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1266/2502] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:56.896018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff1545-cb38-4a28-b80c-4080a6002c73 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:56.909086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9ea6-0a94-4fc2-a6dd-1577d209bda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:56.909850 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9ea6-0a94-4fc2-a6dd-1577d209bda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.910061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9ea6-0a94-4fc2-a6dd-1577d209bda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.910289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff1545-cb38-4a28-b80c-4080a6002c73 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:56.910463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9ea6-0a94-4fc2-a6dd-1577d209bda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.911075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9ea6-0a94-4fc2-a6dd-1577d209bda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:32:56.911377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9ea6-0a94-4fc2-a6dd-1577d209bda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:56.913269 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9ea6-0a94-4fc2-a6dd-1577d209bda5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:56.916861 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e9bf1-ce83-4bad-8a13-cd4b5f784c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:56.917884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e9bf1-ce83-4bad-8a13-cd4b5f784c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.918006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e9bf1-ce83-4bad-8a13-cd4b5f784c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.918187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e9bf1-ce83-4bad-8a13-cd4b5f784c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.918960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e9bf1-ce83-4bad-8a13-cd4b5f784c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:56.920662 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e9bf1-ce83-4bad-8a13-cd4b5f784c0f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:56.930547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1237/2503] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:32:56.937126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1267/2504] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:56.938975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9ea6-0a94-4fc2-a6dd-1577d209bda5 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:56.939120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e9bf1-ce83-4bad-8a13-cd4b5f784c0f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:56.952098 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e9bf1-ce83-4bad-8a13-cd4b5f784c0f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:56.960810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9ea6-0a94-4fc2-a6dd-1577d209bda5 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:56.963291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5057a3-40eb-4a3e-85cf-79b631ed1add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:56.965499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5057a3-40eb-4a3e-85cf-79b631ed1add admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.967819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5057a3-40eb-4a3e-85cf-79b631ed1add admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.969446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5057a3-40eb-4a3e-85cf-79b631ed1add admin admin] PATH_INFO: `/v3/projects/e0fdb63d7ca54c01ae2ca371dbd9254b/users/5bdc337094bb4f0b9c84d286fabf80aa/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.976369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ad87b-8854-47ad-8adf-6afe3a4b9021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:56.978595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ad87b-8854-47ad-8adf-6afe3a4b9021 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:56.978595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ad87b-8854-47ad-8adf-6afe3a4b9021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:56.978595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ad87b-8854-47ad-8adf-6afe3a4b9021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:56.980459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ad87b-8854-47ad-8adf-6afe3a4b9021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:56.984621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ad87b-8854-47ad-8adf-6afe3a4b9021 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:57.013292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5057a3-40eb-4a3e-85cf-79b631ed1add admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fdb63d7ca54c01ae2ca371dbd9254b, user_id=5bdc337094bb4f0b9c84d286fabf80aa, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:57.021167 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5057a3-40eb-4a3e-85cf-79b631ed1add admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:57.114153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1268/2505] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:32:56 2022] PUT /identity/v3/projects/e0fdb63d7ca54c01ae2ca371dbd9254b/users/5bdc337094bb4f0b9c84d286fabf80aa/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:57.130346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1971c-ae6c-4796-980d-17c8b45a66a6 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:57.130346 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1971c-ae6c-4796-980d-17c8b45a66a6 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:57.131668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1971c-ae6c-4796-980d-17c8b45a66a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:57.142585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1238/2506] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:32:56 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:32:57.143857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ad87b-8854-47ad-8adf-6afe3a4b9021 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:57.229773 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-40d1971c-ae6c-4796-980d-17c8b45a66a6 None None] MFA Rules not processed for user `5bdc337094bb4f0b9c84d286fabf80aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:57.231322 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-40d1971c-ae6c-4796-980d-17c8b45a66a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:57.273390 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ad87b-8854-47ad-8adf-6afe3a4b9021 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:57.290471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793d04e-02d0-4321-9888-655406995ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:57.291342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793d04e-02d0-4321-9888-655406995ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:57.291896 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793d04e-02d0-4321-9888-655406995ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:57.291896 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793d04e-02d0-4321-9888-655406995ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:57.292712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793d04e-02d0-4321-9888-655406995ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:57.294693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793d04e-02d0-4321-9888-655406995ef8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:57.386532 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1269/2507] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:32:57.387889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1971c-ae6c-4796-980d-17c8b45a66a6 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:57.404030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1239/2508] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:32:57 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:57.408813 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793d04e-02d0-4321-9888-655406995ef8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:57.424445 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1971c-ae6c-4796-980d-17c8b45a66a6 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:57.430069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6774ab9-f22f-47a6-a41a-047ca005d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:57.430764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6774ab9-f22f-47a6-a41a-047ca005d62f admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:57.431069 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6774ab9-f22f-47a6-a41a-047ca005d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:57.431345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6774ab9-f22f-47a6-a41a-047ca005d62f admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:57.431551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793d04e-02d0-4321-9888-655406995ef8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:57.432015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6774ab9-f22f-47a6-a41a-047ca005d62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:57.434997 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6774ab9-f22f-47a6-a41a-047ca005d62f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:57.439039 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4f51c-4570-4dce-a2d0-f23633b9e04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:57.440071 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4f51c-4570-4dce-a2d0-f23633b9e04d admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:57.440506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4f51c-4570-4dce-a2d0-f23633b9e04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:57.440952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4f51c-4570-4dce-a2d0-f23633b9e04d admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:57.442296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4f51c-4570-4dce-a2d0-f23633b9e04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:57.451062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4f51c-4570-4dce-a2d0-f23633b9e04d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:57.488220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1240/2509] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:32:57.488220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4f51c-4570-4dce-a2d0-f23633b9e04d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:57.514805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4f51c-4570-4dce-a2d0-f23633b9e04d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:57.520748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0c044-58f5-4846-8c28-38298cf63228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:57.521376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0c044-58f5-4846-8c28-38298cf63228 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:57.521672 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0c044-58f5-4846-8c28-38298cf63228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:57.521934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0c044-58f5-4846-8c28-38298cf63228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:57.522671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0c044-58f5-4846-8c28-38298cf63228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:57.524293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0c044-58f5-4846-8c28-38298cf63228 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:57.548788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1241/2510] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:57.550470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0c044-58f5-4846-8c28-38298cf63228 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:57.557862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1270/2511] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:32:57 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:57.561799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6774ab9-f22f-47a6-a41a-047ca005d62f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:57.562690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0c044-58f5-4846-8c28-38298cf63228 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:57.616088 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:57.677354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6774ab9-f22f-47a6-a41a-047ca005d62f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:57.683646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6b9f1-c461-476d-af91-8a257e45ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:57.684609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6b9f1-c461-476d-af91-8a257e45ae99 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:57.684979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6b9f1-c461-476d-af91-8a257e45ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:57.685388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6b9f1-c461-476d-af91-8a257e45ae99 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:57.686270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6b9f1-c461-476d-af91-8a257e45ae99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:57.689468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6b9f1-c461-476d-af91-8a257e45ae99 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:57.693101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffc470-98b9-45e3-83bd-f82e5dc0c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:57.693808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffc470-98b9-45e3-83bd-f82e5dc0c4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:57.694184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffc470-98b9-45e3-83bd-f82e5dc0c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:57.694573 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffc470-98b9-45e3-83bd-f82e5dc0c4c9 admin admin] PATH_INFO: `/v3/projects/7507a44ee4eb495b8e480aa308a694e5/users/edf3990b04c84cf496616995b8a45885/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:57.723759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffc470-98b9-45e3-83bd-f82e5dc0c4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7507a44ee4eb495b8e480aa308a694e5, user_id=edf3990b04c84cf496616995b8a45885, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:57.727096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffc470-98b9-45e3-83bd-f82e5dc0c4c9 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:57.808616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1242/2512] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:32:57 2022] PUT /identity/v3/projects/7507a44ee4eb495b8e480aa308a694e5/users/edf3990b04c84cf496616995b8a45885/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:57.811707 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1271/2513] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:32:57 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:57.818228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffc470-98b9-45e3-83bd-f82e5dc0c4c9 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:57.824049 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836c06d-96e3-44ac-8f54-6c7284574e66 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:57.824355 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836c06d-96e3-44ac-8f54-6c7284574e66 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:57.824616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836c06d-96e3-44ac-8f54-6c7284574e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:57.868961 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-0836c06d-96e3-44ac-8f54-6c7284574e66 None None] MFA Rules not processed for user `edf3990b04c84cf496616995b8a45885`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:57.870551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0836c06d-96e3-44ac-8f54-6c7284574e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:57.876525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:57.917474 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffc470-98b9-45e3-83bd-f82e5dc0c4c9 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:57.925157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45780576-bcff-4e0f-8e9a-f12178890ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:57.926392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780576-bcff-4e0f-8e9a-f12178890ead admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:57.926745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780576-bcff-4e0f-8e9a-f12178890ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:57.927060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780576-bcff-4e0f-8e9a-f12178890ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:57.928174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45780576-bcff-4e0f-8e9a-f12178890ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:57.930683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45780576-bcff-4e0f-8e9a-f12178890ead admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:57.954023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1243/2514] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:57.955805 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45780576-bcff-4e0f-8e9a-f12178890ead admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:57.977316 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45780576-bcff-4e0f-8e9a-f12178890ead admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:57.991646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3936cd-c0a3-4361-8395-2ce3e320c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:57.993108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3936cd-c0a3-4361-8395-2ce3e320c9ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:57.993744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3936cd-c0a3-4361-8395-2ce3e320c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:57.994368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3936cd-c0a3-4361-8395-2ce3e320c9ce admin admin] PATH_INFO: `/v3/projects/b1f537e8ce14422db42f4639903eb08e/users/067ec9933230479481fd82284c59324b/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.029952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3936cd-c0a3-4361-8395-2ce3e320c9ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f537e8ce14422db42f4639903eb08e, user_id=067ec9933230479481fd82284c59324b, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:58.035349 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3936cd-c0a3-4361-8395-2ce3e320c9ce admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:58.047403 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1272/2515] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:58.052511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836c06d-96e3-44ac-8f54-6c7284574e66 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:58.076649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836c06d-96e3-44ac-8f54-6c7284574e66 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:58.082715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7b9c-ed98-4e16-862b-e5129db018c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:58.083350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7b9c-ed98-4e16-862b-e5129db018c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.083632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7b9c-ed98-4e16-862b-e5129db018c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.083906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7b9c-ed98-4e16-862b-e5129db018c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.084576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7b9c-ed98-4e16-862b-e5129db018c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:58.087633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7b9c-ed98-4e16-862b-e5129db018c1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:58.112579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1244/2516] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:32:57 2022] PUT /identity/v3/projects/b1f537e8ce14422db42f4639903eb08e/users/067ec9933230479481fd82284c59324b/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:58.116428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3936cd-c0a3-4361-8395-2ce3e320c9ce admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:58.214895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3936cd-c0a3-4361-8395-2ce3e320c9ce admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:58.222064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646441-45ec-4f37-b9b1-12427d359b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:58.222793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646441-45ec-4f37-b9b1-12427d359b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.223160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646441-45ec-4f37-b9b1-12427d359b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.223628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646441-45ec-4f37-b9b1-12427d359b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.224259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05646441-45ec-4f37-b9b1-12427d359b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:58.226332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05646441-45ec-4f37-b9b1-12427d359b97 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:58.245683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1245/2517] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:32:58.249583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646441-45ec-4f37-b9b1-12427d359b97 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:58.263560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646441-45ec-4f37-b9b1-12427d359b97 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:58.277651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1273/2518] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:32:58 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:32:58.281321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7b9c-ed98-4e16-862b-e5129db018c1 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:58.285204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aedce6-a4cb-4bb7-8ff6-655641add8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:58.285920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aedce6-a4cb-4bb7-8ff6-655641add8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.286201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aedce6-a4cb-4bb7-8ff6-655641add8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.286558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aedce6-a4cb-4bb7-8ff6-655641add8ad admin admin] PATH_INFO: `/v3/projects/b1f537e8ce14422db42f4639903eb08e/users/067ec9933230479481fd82284c59324b/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.295734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aedce6-a4cb-4bb7-8ff6-655641add8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f537e8ce14422db42f4639903eb08e, user_id=067ec9933230479481fd82284c59324b, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:58.298607 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aedce6-a4cb-4bb7-8ff6-655641add8ad admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:58.325681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1246/2519] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:32:58 2022] PUT /identity/v3/projects/b1f537e8ce14422db42f4639903eb08e/users/067ec9933230479481fd82284c59324b/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:32:58.356667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a165ea-c7b7-4d99-a708-764310831e10 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.356938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a165ea-c7b7-4d99-a708-764310831e10 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.357223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a165ea-c7b7-4d99-a708-764310831e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.390726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:58.421297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-00a165ea-c7b7-4d99-a708-764310831e10 None None] MFA Rules not processed for user `067ec9933230479481fd82284c59324b`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:58.429457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-00a165ea-c7b7-4d99-a708-764310831e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:58.446376 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7b9c-ed98-4e16-862b-e5129db018c1 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:58.555010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21b1e-4703-4685-b97b-e1e8399a116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:58.555640 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21b1e-4703-4685-b97b-e1e8399a116a admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.556071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21b1e-4703-4685-b97b-e1e8399a116a admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.556573 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21b1e-4703-4685-b97b-e1e8399a116a admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.557233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd21b1e-4703-4685-b97b-e1e8399a116a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:58.559610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd21b1e-4703-4685-b97b-e1e8399a116a admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:58.585926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1247/2520] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:58.597107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a165ea-c7b7-4d99-a708-764310831e10 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:58.599348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-00a165ea-c7b7-4d99-a708-764310831e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:58.677449 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a165ea-c7b7-4d99-a708-764310831e10 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:58.677732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1274/2521] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:32:58 2022] POST /identity/v3/users => generated 294 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:58.682103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21b1e-4703-4685-b97b-e1e8399a116a admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:58.686034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716add22-b1e9-4648-a73c-e19299392802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:58.686996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716add22-b1e9-4648-a73c-e19299392802 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.687506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716add22-b1e9-4648-a73c-e19299392802 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.687919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716add22-b1e9-4648-a73c-e19299392802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.694676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21b1e-4703-4685-b97b-e1e8399a116a admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:58.700866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348528a-3d38-474b-bc0b-2645ddb12776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:58.701638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348528a-3d38-474b-bc0b-2645ddb12776 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.702005 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348528a-3d38-474b-bc0b-2645ddb12776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.702430 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348528a-3d38-474b-bc0b-2645ddb12776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.703432 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348528a-3d38-474b-bc0b-2645ddb12776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:58.705878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348528a-3d38-474b-bc0b-2645ddb12776 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:58.707297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716add22-b1e9-4648-a73c-e19299392802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:58.708888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716add22-b1e9-4648-a73c-e19299392802 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:58.721725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1275/2522] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:32:58.724206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1248/2523] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:32:58.734766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348528a-3d38-474b-bc0b-2645ddb12776 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:58.756025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348528a-3d38-474b-bc0b-2645ddb12776 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:58.770714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b36ed-4378-4496-bc83-eb20a6386211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:58.771461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b36ed-4378-4496-bc83-eb20a6386211 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.771747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b36ed-4378-4496-bc83-eb20a6386211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.772048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b36ed-4378-4496-bc83-eb20a6386211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.772784 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b36ed-4378-4496-bc83-eb20a6386211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:58.774418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b36ed-4378-4496-bc83-eb20a6386211 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:58.783762 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:58.793232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1276/2524] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:58.797336 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716add22-b1e9-4648-a73c-e19299392802 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:58.827099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716add22-b1e9-4648-a73c-e19299392802 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:58.827099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8c85b-4e98-4f39-968a-b249a439196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:58.827099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8c85b-4e98-4f39-968a-b249a439196e admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.827099 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8c85b-4e98-4f39-968a-b249a439196e admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.827540 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8c85b-4e98-4f39-968a-b249a439196e admin admin] PATH_INFO: `/v3/projects/63b464d0a1194469970536f7da6ac7e8/users/0d92be6428ce4315922f52fcfc51fbb8/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.851923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8c85b-4e98-4f39-968a-b249a439196e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b464d0a1194469970536f7da6ac7e8, user_id=0d92be6428ce4315922f52fcfc51fbb8, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:58.871011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8c85b-4e98-4f39-968a-b249a439196e admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:58.872798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b36ed-4378-4496-bc83-eb20a6386211 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:58.887742 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b36ed-4378-4496-bc83-eb20a6386211 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:58.894043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471695fa-8dbd-4f86-9732-0ed74bf76222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:58.895817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471695fa-8dbd-4f86-9732-0ed74bf76222 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.896523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471695fa-8dbd-4f86-9732-0ed74bf76222 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.897691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471695fa-8dbd-4f86-9732-0ed74bf76222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:58.947262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1249/2525] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:32:58 2022] PUT /identity/v3/projects/63b464d0a1194469970536f7da6ac7e8/users/0d92be6428ce4315922f52fcfc51fbb8/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:32:58.961198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd03d48-959b-4bd3-8191-3521d8ac81f6 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:58.961563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd03d48-959b-4bd3-8191-3521d8ac81f6 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:58.961838 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd03d48-959b-4bd3-8191-3521d8ac81f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:59.004656 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8cd03d48-959b-4bd3-8191-3521d8ac81f6 None None] MFA Rules not processed for user `0d92be6428ce4315922f52fcfc51fbb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:32:59.005826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8cd03d48-959b-4bd3-8191-3521d8ac81f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:32:59.010008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471695fa-8dbd-4f86-9732-0ed74bf76222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:59.012211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471695fa-8dbd-4f86-9732-0ed74bf76222 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:59.025315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1277/2526] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:32:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:32:59.175416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:59.206393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1250/2527] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:32:59.211015 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471695fa-8dbd-4f86-9732-0ed74bf76222 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:59.246722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471695fa-8dbd-4f86-9732-0ed74bf76222 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:59.402593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01482f5a-35fa-4f6a-af9f-901ab796d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:59.403514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482f5a-35fa-4f6a-af9f-901ab796d154 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:59.403798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482f5a-35fa-4f6a-af9f-901ab796d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:59.404078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01482f5a-35fa-4f6a-af9f-901ab796d154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:59.404744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01482f5a-35fa-4f6a-af9f-901ab796d154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:59.409304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01482f5a-35fa-4f6a-af9f-901ab796d154 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:59.575719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1278/2528] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:32:59 2022] POST /identity/v3/projects => generated 387 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:59.575990 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd03d48-959b-4bd3-8191-3521d8ac81f6 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:59.598641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd03d48-959b-4bd3-8191-3521d8ac81f6 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:59.696951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16731c0b-94e4-4b41-9ed5-3427371bdf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:59.697701 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16731c0b-94e4-4b41-9ed5-3427371bdf69 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:59.698044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16731c0b-94e4-4b41-9ed5-3427371bdf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:59.698417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16731c0b-94e4-4b41-9ed5-3427371bdf69 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:59.699175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16731c0b-94e4-4b41-9ed5-3427371bdf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:59.702127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16731c0b-94e4-4b41-9ed5-3427371bdf69 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:59.864693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1251/2529] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:32:59 2022] POST /identity/v3/users => generated 300 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:32:59.868987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01482f5a-35fa-4f6a-af9f-901ab796d154 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:59.887849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01482f5a-35fa-4f6a-af9f-901ab796d154 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:59.898950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecde20-977c-4fc4-bac3-eb025b7a379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:59.900598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecde20-977c-4fc4-bac3-eb025b7a379c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:59.901035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecde20-977c-4fc4-bac3-eb025b7a379c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:59.901414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecde20-977c-4fc4-bac3-eb025b7a379c admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:32:59.902263 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecde20-977c-4fc4-bac3-eb025b7a379c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:32:59.905756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecde20-977c-4fc4-bac3-eb025b7a379c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:32:59.935543 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16731c0b-94e4-4b41-9ed5-3427371bdf69 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:32:59.941399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1279/2530] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:32:59.958287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16731c0b-94e4-4b41-9ed5-3427371bdf69 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:32:59.978279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1d3f-606b-45a6-aeac-f94564b925f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:32:59.979043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1d3f-606b-45a6-aeac-f94564b925f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:32:59.979325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1d3f-606b-45a6-aeac-f94564b925f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:32:59.979627 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1d3f-606b-45a6-aeac-f94564b925f2 admin admin] PATH_INFO: `/v3/projects/417532a9b4d241c19d25e093f23fed30/users/412f2a412de441ab80d320be55684fc5/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:00.007443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed1d3f-606b-45a6-aeac-f94564b925f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417532a9b4d241c19d25e093f23fed30, user_id=412f2a412de441ab80d320be55684fc5, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:00.010248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed1d3f-606b-45a6-aeac-f94564b925f2 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:00.080037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1252/2531] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:32:59 2022] PUT /identity/v3/projects/417532a9b4d241c19d25e093f23fed30/users/412f2a412de441ab80d320be55684fc5/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:00.083962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecde20-977c-4fc4-bac3-eb025b7a379c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:00.099007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecde20-977c-4fc4-bac3-eb025b7a379c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:00.148405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1d3f-606b-45a6-aeac-f94564b925f2 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:00.150261 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8eed1d3f-606b-45a6-aeac-f94564b925f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:00.197124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c9e2a-d37d-456f-9a8f-2c7d2eaa2b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:00.197754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c9e2a-d37d-456f-9a8f-2c7d2eaa2b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:00.198028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c9e2a-d37d-456f-9a8f-2c7d2eaa2b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:00.199996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c9e2a-d37d-456f-9a8f-2c7d2eaa2b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:00.199996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c9e2a-d37d-456f-9a8f-2c7d2eaa2b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:00.201090 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c9e2a-d37d-456f-9a8f-2c7d2eaa2b32 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:00.213042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1280/2532] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:00.216972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c9e2a-d37d-456f-9a8f-2c7d2eaa2b32 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:00.234704 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c9e2a-d37d-456f-9a8f-2c7d2eaa2b32 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:00.247159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53fac4-5425-4db2-b1f5-4226b37ed122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:00.248091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53fac4-5425-4db2-b1f5-4226b37ed122 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:00.248377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53fac4-5425-4db2-b1f5-4226b37ed122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:00.248654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53fac4-5425-4db2-b1f5-4226b37ed122 admin admin] PATH_INFO: `/v3/projects/417532a9b4d241c19d25e093f23fed30/users/412f2a412de441ab80d320be55684fc5/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:00.250937 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53fac4-5425-4db2-b1f5-4226b37ed122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417532a9b4d241c19d25e093f23fed30, user_id=412f2a412de441ab80d320be55684fc5, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:00.253085 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1d3f-606b-45a6-aeac-f94564b925f2 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:00.254950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53fac4-5425-4db2-b1f5-4226b37ed122 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:00.258933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:00.260050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:00.260835 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:00.261208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:00.261912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] PATH_INFO: `/v3/users/965cf2aad5bc4def9fca55aac87cc37e` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:00.263043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965cf2aad5bc4def9fca55aac87cc37e)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:00.266045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:00.271525 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1281/2533] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:00 2022] PUT /identity/v3/projects/417532a9b4d241c19d25e093f23fed30/users/412f2a412de441ab80d320be55684fc5/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:00.283231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a42734-d6d1-447f-9e1d-52d506538c51 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:00.283231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a42734-d6d1-447f-9e1d-52d506538c51 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:00.283555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a42734-d6d1-447f-9e1d-52d506538c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:00.317143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-08a42734-d6d1-447f-9e1d-52d506538c51 None None] MFA Rules not processed for user `412f2a412de441ab80d320be55684fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:00.318452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-08a42734-d6d1-447f-9e1d-52d506538c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:00.431353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1282/2534] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:00.441334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a42734-d6d1-447f-9e1d-52d506538c51 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:00.461416 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965cf2aad5bc4def9fca55aac87cc37e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:00.462378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965cf2aad5bc4def9fca55aac87cc37e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:00.486654 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965cf2aad5bc4def9fca55aac87cc37e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:00.487655 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965cf2aad5bc4def9fca55aac87cc37e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:00.521809 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a42734-d6d1-447f-9e1d-52d506538c51 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:00.525845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2516ee-5e7d-4dd0-89ab-958cd907c31c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:00.526700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2516ee-5e7d-4dd0-89ab-958cd907c31c service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:00.527003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2516ee-5e7d-4dd0-89ab-958cd907c31c service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:00.527296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2516ee-5e7d-4dd0-89ab-958cd907c31c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:00.529358 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2c2516ee-5e7d-4dd0-89ab-958cd907c31c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:00.543036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2516ee-5e7d-4dd0-89ab-958cd907c31c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:00.544640 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2516ee-5e7d-4dd0-89ab-958cd907c31c service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:00.556064 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965cf2aad5bc4def9fca55aac87cc37e'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:00.559185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:00.571321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1283/2535] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:00.587539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1253/2536] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:00 2022] DELETE /identity/v3/users/965cf2aad5bc4def9fca55aac87cc37e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:00.904304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2516ee-5e7d-4dd0-89ab-958cd907c31c service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:00.905722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2c2516ee-5e7d-4dd0-89ab-958cd907c31c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:01.026821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2516ee-5e7d-4dd0-89ab-958cd907c31c service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:01.066839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:01.150635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:01.151370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:01.151705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:01.151974 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] PATH_INFO: `/v3/projects/e32569df1dca45cebcdd63d03ff5abae` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:01.153738 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32569df1dca45cebcdd63d03ff5abae)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:01.159619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:01.335954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32569df1dca45cebcdd63d03ff5abae', 'request_id': 'req-8208d7f3-686c-4bc4-9948-b2854e95ff8f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:01.350340 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32569df1dca45cebcdd63d03ff5abae', 'request_id': 'req-8208d7f3-686c-4bc4-9948-b2854e95ff8f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:01.504861 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32569df1dca45cebcdd63d03ff5abae', 'request_id': 'req-8208d7f3-686c-4bc4-9948-b2854e95ff8f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:01.518212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] The token cache is being invalidate because project e32569df1dca45cebcdd63d03ff5abae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:01.518581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:01.519349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:01.520904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1284/2537] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:00 2022] DELETE /identity/v3/projects/e32569df1dca45cebcdd63d03ff5abae => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:01.533950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:01.550901 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e459c4-0f51-4c9a-98e2-573c702008b4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:01.622636 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:01.623709 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:01.624229 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:01.624725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] PATH_INFO: `/v3/users/bbf747c57a314a9f9c3546ca5409d543` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:01.626890 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf747c57a314a9f9c3546ca5409d543)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:01.628916 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:02.627304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf747c57a314a9f9c3546ca5409d543'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:02.631092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf747c57a314a9f9c3546ca5409d543'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:02.640114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf747c57a314a9f9c3546ca5409d543'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:02.640977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf747c57a314a9f9c3546ca5409d543'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:02.687251 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf747c57a314a9f9c3546ca5409d543'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:02.713181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1254/2538] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:01 2022] DELETE /identity/v3/users/bbf747c57a314a9f9c3546ca5409d543 => generated 0 bytes in 1180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:02.890378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:02.891905 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:02.989870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208d7f3-686c-4bc4-9948-b2854e95ff8f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:03.061201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8755592-cae2-4009-b732-130e28f4ed2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:03.062282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755592-cae2-4009-b732-130e28f4ed2a service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:03.067793 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755592-cae2-4009-b732-130e28f4ed2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:03.068095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755592-cae2-4009-b732-130e28f4ed2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:03.070516 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b8755592-cae2-4009-b732-130e28f4ed2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:03.086575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:03.087529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:03.137970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:03.197329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8755592-cae2-4009-b732-130e28f4ed2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:03.199833 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8755592-cae2-4009-b732-130e28f4ed2a service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:03.202792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1b9fb-863b-4ebe-9973-1547478271d0 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:03.210975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:03.214638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:03.214638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:03.214638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] PATH_INFO: `/v3/projects/a68c71fa88104e14a9b840fa7c64de64` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:03.214638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68c71fa88104e14a9b840fa7c64de64)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:03.223928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:03.226337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1285/2539] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:03.227500 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:03.430357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68c71fa88104e14a9b840fa7c64de64', 'request_id': 'req-c9997fe8-db18-459f-9a03-cfbfd960f0bd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:03.442643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68c71fa88104e14a9b840fa7c64de64', 'request_id': 'req-c9997fe8-db18-459f-9a03-cfbfd960f0bd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:03.568432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68c71fa88104e14a9b840fa7c64de64', 'request_id': 'req-c9997fe8-db18-459f-9a03-cfbfd960f0bd'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:03.593674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] The token cache is being invalidate because project a68c71fa88104e14a9b840fa7c64de64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:03.593960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:03.595171 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c9997fe8-db18-459f-9a03-cfbfd960f0bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:03.610811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1255/2540] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:03 2022] DELETE /identity/v3/projects/a68c71fa88104e14a9b840fa7c64de64 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:03.691602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8755592-cae2-4009-b732-130e28f4ed2a service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:03.693337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b8755592-cae2-4009-b732-130e28f4ed2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:03.825606 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8755592-cae2-4009-b732-130e28f4ed2a service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:03.904378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:03.905148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:03.905354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:03.905695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] PATH_INFO: `/v3/users/5bdc337094bb4f0b9c84d286fabf80aa` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:03.907062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bdc337094bb4f0b9c84d286fabf80aa)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:03.910231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:04.597684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bdc337094bb4f0b9c84d286fabf80aa'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:04.598389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bdc337094bb4f0b9c84d286fabf80aa'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:04.606042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bdc337094bb4f0b9c84d286fabf80aa'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:04.625114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bdc337094bb4f0b9c84d286fabf80aa'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:04.698942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bdc337094bb4f0b9c84d286fabf80aa'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:04.700669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:04.706574 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1286/2541] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:03 2022] DELETE /identity/v3/users/5bdc337094bb4f0b9c84d286fabf80aa => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:04.711545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47fd3f-5947-426c-b22a-02903c129bc0 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:04.712113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47fd3f-5947-426c-b22a-02903c129bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:04.712113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47fd3f-5947-426c-b22a-02903c129bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:04.741327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-4f47fd3f-5947-426c-b22a-02903c129bc0 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:04.742705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4f47fd3f-5947-426c-b22a-02903c129bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:04.804965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1256/2542] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:04.816025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:04.824314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:04.893877 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf4c37-a98e-4fb1-88e8-9f0cc00e4b3b admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:04.897458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d44ae-d5bb-46c9-9698-6564bdc4556d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:04.898369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d44ae-d5bb-46c9-9698-6564bdc4556d service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:04.898734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d44ae-d5bb-46c9-9698-6564bdc4556d service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:04.899074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d44ae-d5bb-46c9-9698-6564bdc4556d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:04.909078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d44ae-d5bb-46c9-9698-6564bdc4556d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:04.910535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d44ae-d5bb-46c9-9698-6564bdc4556d service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:04.919901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1287/2543] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:05.318873 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47fd3f-5947-426c-b22a-02903c129bc0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:05.320461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4f47fd3f-5947-426c-b22a-02903c129bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:05.333580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47fd3f-5947-426c-b22a-02903c129bc0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:05.338526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:05.339176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:05.339456 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:05.339729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] PATH_INFO: `/v3/projects/e0fdb63d7ca54c01ae2ca371dbd9254b` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:05.341138 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fdb63d7ca54c01ae2ca371dbd9254b)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:05.343248 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:05.454648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fdb63d7ca54c01ae2ca371dbd9254b', 'request_id': 'req-2681257c-4f6d-4be9-9928-49154e8a8e6b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:05.460866 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fdb63d7ca54c01ae2ca371dbd9254b', 'request_id': 'req-2681257c-4f6d-4be9-9928-49154e8a8e6b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:05.527058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fdb63d7ca54c01ae2ca371dbd9254b', 'request_id': 'req-2681257c-4f6d-4be9-9928-49154e8a8e6b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:05.532778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:05.539037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] The token cache is being invalidate because project e0fdb63d7ca54c01ae2ca371dbd9254b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:05.539320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:05.539942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:05.541437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1257/2544] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:05 2022] DELETE /identity/v3/projects/e0fdb63d7ca54c01ae2ca371dbd9254b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:05.545494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d44ae-d5bb-46c9-9698-6564bdc4556d service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:05.555818 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d44ae-d5bb-46c9-9698-6564bdc4556d service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:05.613109 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:05.613326 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:05.613540 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:05.613810 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] PATH_INFO: `/v3/users/067ec9933230479481fd82284c59324b` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:05.615100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=067ec9933230479481fd82284c59324b)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:05.617061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:05.794384 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067ec9933230479481fd82284c59324b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:05.795203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067ec9933230479481fd82284c59324b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:05.803374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067ec9933230479481fd82284c59324b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:05.816116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067ec9933230479481fd82284c59324b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:05.881385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-7f5a85fd-f3b7-46d4-961b-6b94353629bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067ec9933230479481fd82284c59324b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:05.887821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1288/2545] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:05 2022] DELETE /identity/v3/users/067ec9933230479481fd82284c59324b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:06.312378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:06.314640 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:06.327506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681257c-4f6d-4be9-9928-49154e8a8e6b admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:06.387023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:06.387665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:06.387961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:06.388324 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] PATH_INFO: `/v3/projects/b1f537e8ce14422db42f4639903eb08e` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:06.389594 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f537e8ce14422db42f4639903eb08e)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:06.392287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:06.503190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f537e8ce14422db42f4639903eb08e', 'request_id': 'req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:06.510178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f537e8ce14422db42f4639903eb08e', 'request_id': 'req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:06.572864 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f537e8ce14422db42f4639903eb08e', 'request_id': 'req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:06.585445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] The token cache is being invalidate because project b1f537e8ce14422db42f4639903eb08e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:06.585733 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:06.586427 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-b0fcacfc-0c6d-4c87-9351-98260a6b2f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:06.587953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1258/2546] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:06 2022] DELETE /identity/v3/projects/b1f537e8ce14422db42f4639903eb08e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:06.593228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea89f-31a5-4260-a7fb-8aea60ec2817 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:06.595619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea89f-31a5-4260-a7fb-8aea60ec2817 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:06.595619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea89f-31a5-4260-a7fb-8aea60ec2817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:06.600833 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:06.648852 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-45dea89f-31a5-4260-a7fb-8aea60ec2817 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:06.649960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-45dea89f-31a5-4260-a7fb-8aea60ec2817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:06.711813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1289/2547] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:06.721302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784edc58-c845-4919-bb2c-b04f8be70e17 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:06.721584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784edc58-c845-4919-bb2c-b04f8be70e17 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:06.721884 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784edc58-c845-4919-bb2c-b04f8be70e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:06.743976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-784edc58-c845-4919-bb2c-b04f8be70e17 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:06.745286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-784edc58-c845-4919-bb2c-b04f8be70e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:06.754378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1259/2548] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:06.758499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dea89f-31a5-4260-a7fb-8aea60ec2817 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:06.768719 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dea89f-31a5-4260-a7fb-8aea60ec2817 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:06.773418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c550a44-845d-4049-a43f-591490eebe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:06.774002 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c550a44-845d-4049-a43f-591490eebe09 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:06.774271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c550a44-845d-4049-a43f-591490eebe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:06.774565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c550a44-845d-4049-a43f-591490eebe09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:06.775252 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c550a44-845d-4049-a43f-591490eebe09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:33:06.775547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c550a44-845d-4049-a43f-591490eebe09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:06.777230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c550a44-845d-4049-a43f-591490eebe09 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:06.790677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1290/2549] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:33:06.794451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784edc58-c845-4919-bb2c-b04f8be70e17 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:06.804575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784edc58-c845-4919-bb2c-b04f8be70e17 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:06.809269 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be37fc-dabc-4398-b190-bc2e78c6ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:06.809875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be37fc-dabc-4398-b190-bc2e78c6ee39 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:06.810153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be37fc-dabc-4398-b190-bc2e78c6ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:06.810467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be37fc-dabc-4398-b190-bc2e78c6ee39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:06.811140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be37fc-dabc-4398-b190-bc2e78c6ee39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:06.813043 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be37fc-dabc-4398-b190-bc2e78c6ee39 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:06.909664 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1260/2550] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:06 2022] POST /identity/v3/projects => generated 409 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:06.910831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c550a44-845d-4049-a43f-591490eebe09 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:06.921948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c550a44-845d-4049-a43f-591490eebe09 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:06.984592 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b991c7-dd93-4f27-a64e-7921c9f75713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:06.985374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b991c7-dd93-4f27-a64e-7921c9f75713 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:06.985777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b991c7-dd93-4f27-a64e-7921c9f75713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:06.986138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b991c7-dd93-4f27-a64e-7921c9f75713 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:06.986857 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b991c7-dd93-4f27-a64e-7921c9f75713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:06.988803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b991c7-dd93-4f27-a64e-7921c9f75713 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:07.082137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1291/2551] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:06 2022] POST /identity/v3/users => generated 305 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:07.086572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be37fc-dabc-4398-b190-bc2e78c6ee39 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:07.097069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be37fc-dabc-4398-b190-bc2e78c6ee39 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:07.103535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b30bc9-3635-4196-b54b-889ee6c974ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:07.104159 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b30bc9-3635-4196-b54b-889ee6c974ff admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:07.104441 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b30bc9-3635-4196-b54b-889ee6c974ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:07.104747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b30bc9-3635-4196-b54b-889ee6c974ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:07.105471 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b30bc9-3635-4196-b54b-889ee6c974ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:07.107184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b30bc9-3635-4196-b54b-889ee6c974ff admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:07.117841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1261/2552] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:07.122194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b991c7-dd93-4f27-a64e-7921c9f75713 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:07.133418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b991c7-dd93-4f27-a64e-7921c9f75713 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:07.138231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f491c3-cd7d-4166-b567-218d083a289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:07.138866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f491c3-cd7d-4166-b567-218d083a289f admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:07.139143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f491c3-cd7d-4166-b567-218d083a289f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:07.139411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f491c3-cd7d-4166-b567-218d083a289f admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:07.140089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f491c3-cd7d-4166-b567-218d083a289f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:07.142678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f491c3-cd7d-4166-b567-218d083a289f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:07.153686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1292/2553] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:07.158448 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b30bc9-3635-4196-b54b-889ee6c974ff admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:07.169332 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b30bc9-3635-4196-b54b-889ee6c974ff admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:07.174616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107034f-82c3-409f-8df4-68fbdf51ea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:07.175270 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107034f-82c3-409f-8df4-68fbdf51ea40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:07.175544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107034f-82c3-409f-8df4-68fbdf51ea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:07.175852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107034f-82c3-409f-8df4-68fbdf51ea40 admin admin] PATH_INFO: `/v3/projects/93db3919d1de430db2264961580931c5/users/40abc905f0a241ad9c2194590b21e0f9/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:07.191829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107034f-82c3-409f-8df4-68fbdf51ea40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93db3919d1de430db2264961580931c5, user_id=40abc905f0a241ad9c2194590b21e0f9, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:07.194740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107034f-82c3-409f-8df4-68fbdf51ea40 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:07.287468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1262/2554] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:07 2022] PUT /identity/v3/projects/93db3919d1de430db2264961580931c5/users/40abc905f0a241ad9c2194590b21e0f9/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:07.298183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6392b-98dd-42bb-8fbc-c1db182c3d36 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:07.298494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6392b-98dd-42bb-8fbc-c1db182c3d36 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:07.298767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6392b-98dd-42bb-8fbc-c1db182c3d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:07.328563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-e2f6392b-98dd-42bb-8fbc-c1db182c3d36 None None] MFA Rules not processed for user `40abc905f0a241ad9c2194590b21e0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:07.330037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e2f6392b-98dd-42bb-8fbc-c1db182c3d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:07.363147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:07.393385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1293/2555] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:07 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:07.397991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107034f-82c3-409f-8df4-68fbdf51ea40 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:07.427923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:07.464762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107034f-82c3-409f-8df4-68fbdf51ea40 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:07.469589 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00ff09-68d9-4732-9716-1470274d0b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:07.470292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00ff09-68d9-4732-9716-1470274d0b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:07.470624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00ff09-68d9-4732-9716-1470274d0b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:07.470885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00ff09-68d9-4732-9716-1470274d0b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:07.471559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00ff09-68d9-4732-9716-1470274d0b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:07.473494 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00ff09-68d9-4732-9716-1470274d0b29 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:07.608352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1263/2556] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:07 2022] POST /identity/v3/projects => generated 409 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:07.612969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6392b-98dd-42bb-8fbc-c1db182c3d36 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:07.623836 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6392b-98dd-42bb-8fbc-c1db182c3d36 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:07.684744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e2f03-e08b-4e6f-a060-54dc4a64092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:07.685639 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e2f03-e08b-4e6f-a060-54dc4a64092e admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:07.685887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e2f03-e08b-4e6f-a060-54dc4a64092e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:07.686092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e2f03-e08b-4e6f-a060-54dc4a64092e admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:07.686894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e2f03-e08b-4e6f-a060-54dc4a64092e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:07.689402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e2f03-e08b-4e6f-a060-54dc4a64092e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:07.785972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1294/2557] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:07 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:33:07.790017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00ff09-68d9-4732-9716-1470274d0b29 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:07.801745 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00ff09-68d9-4732-9716-1470274d0b29 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:07.806690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4160d3f-8b4d-4628-bbbd-6edca9c7ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:07.807295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4160d3f-8b4d-4628-bbbd-6edca9c7ba13 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:07.807570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4160d3f-8b4d-4628-bbbd-6edca9c7ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:07.807841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4160d3f-8b4d-4628-bbbd-6edca9c7ba13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:07.808536 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4160d3f-8b4d-4628-bbbd-6edca9c7ba13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:07.810170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4160d3f-8b4d-4628-bbbd-6edca9c7ba13 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:07.820993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1264/2558] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:07.825384 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e2f03-e08b-4e6f-a060-54dc4a64092e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:07.835401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e2f03-e08b-4e6f-a060-54dc4a64092e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:07.840364 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6d4db-f4ba-4fae-8567-884437af316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:07.841130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6d4db-f4ba-4fae-8567-884437af316a admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:07.841411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6d4db-f4ba-4fae-8567-884437af316a admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:07.841801 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6d4db-f4ba-4fae-8567-884437af316a admin admin] PATH_INFO: `/v3/projects/f6b80713be0540c8a41b1289cc0da59d/users/09e5ed5ecc5941a1a11529cd59012a87/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:07.857604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6d4db-f4ba-4fae-8567-884437af316a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b80713be0540c8a41b1289cc0da59d, user_id=09e5ed5ecc5941a1a11529cd59012a87, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:07.860928 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6d4db-f4ba-4fae-8567-884437af316a admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:07.911255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1295/2559] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:07 2022] PUT /identity/v3/projects/f6b80713be0540c8a41b1289cc0da59d/users/09e5ed5ecc5941a1a11529cd59012a87/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:07.919293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4160d3f-8b4d-4628-bbbd-6edca9c7ba13 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:07.930278 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4160d3f-8b4d-4628-bbbd-6edca9c7ba13 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:07.988481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f283970-0089-4fc8-8d0a-d6d7e980950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:07.989006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283970-0089-4fc8-8d0a-d6d7e980950a admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:07.989286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283970-0089-4fc8-8d0a-d6d7e980950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:07.989558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283970-0089-4fc8-8d0a-d6d7e980950a admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:07.990237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283970-0089-4fc8-8d0a-d6d7e980950a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:07.991848 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283970-0089-4fc8-8d0a-d6d7e980950a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:08.001715 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1265/2560] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:08.006047 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6d4db-f4ba-4fae-8567-884437af316a admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:08.016786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6d4db-f4ba-4fae-8567-884437af316a admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:08.021405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ec85-2c5d-4ca1-92fe-22d0d6b5bd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:08.022050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ec85-2c5d-4ca1-92fe-22d0d6b5bd8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:08.022350 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ec85-2c5d-4ca1-92fe-22d0d6b5bd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:08.022629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ec85-2c5d-4ca1-92fe-22d0d6b5bd8f admin admin] PATH_INFO: `/v3/projects/f6b80713be0540c8a41b1289cc0da59d/users/09e5ed5ecc5941a1a11529cd59012a87/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:08.024598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54ec85-2c5d-4ca1-92fe-22d0d6b5bd8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b80713be0540c8a41b1289cc0da59d, user_id=09e5ed5ecc5941a1a11529cd59012a87, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:08.027250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54ec85-2c5d-4ca1-92fe-22d0d6b5bd8f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:08.038211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1296/2561] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:08 2022] PUT /identity/v3/projects/f6b80713be0540c8a41b1289cc0da59d/users/09e5ed5ecc5941a1a11529cd59012a87/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:08.048624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8430c-059d-4202-ada5-fe981893cfe9 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:08.048990 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8430c-059d-4202-ada5-fe981893cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:08.049417 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8430c-059d-4202-ada5-fe981893cfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:08.077770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d7a8430c-059d-4202-ada5-fe981893cfe9 None None] MFA Rules not processed for user `09e5ed5ecc5941a1a11529cd59012a87`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:08.079617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d7a8430c-059d-4202-ada5-fe981893cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:08.155665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1266/2562] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:08 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:08.167655 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ec85-2c5d-4ca1-92fe-22d0d6b5bd8f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:08.169358 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-cf54ec85-2c5d-4ca1-92fe-22d0d6b5bd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:08.233685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ec85-2c5d-4ca1-92fe-22d0d6b5bd8f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:08.237491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8765d-011b-45fd-8c81-645fc53156db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:08.238127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8765d-011b-45fd-8c81-645fc53156db service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:08.238399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8765d-011b-45fd-8c81-645fc53156db service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:08.238721 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8765d-011b-45fd-8c81-645fc53156db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:08.247969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8765d-011b-45fd-8c81-645fc53156db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:08.249394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8765d-011b-45fd-8c81-645fc53156db service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:08.258853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1297/2563] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:08 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:08.568614 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8430c-059d-4202-ada5-fe981893cfe9 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:08.577685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8430c-059d-4202-ada5-fe981893cfe9 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:08.581344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0cc7f-0173-4a35-bfbd-08e1a7f8a8da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:08.581944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0cc7f-0173-4a35-bfbd-08e1a7f8a8da service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:08.582218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0cc7f-0173-4a35-bfbd-08e1a7f8a8da service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:08.582515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0cc7f-0173-4a35-bfbd-08e1a7f8a8da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:08.597671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:08.645391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0cc7f-0173-4a35-bfbd-08e1a7f8a8da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:08.646874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0cc7f-0173-4a35-bfbd-08e1a7f8a8da service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:08.656942 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1267/2564] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:08 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:08.879817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8765d-011b-45fd-8c81-645fc53156db service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:08.881208 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8ba8765d-011b-45fd-8c81-645fc53156db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:08.892617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8765d-011b-45fd-8c81-645fc53156db service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:08.896607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25df37e-63a2-4887-baa8-649703600350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:08.897213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25df37e-63a2-4887-baa8-649703600350 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:08.897492 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25df37e-63a2-4887-baa8-649703600350 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:08.898201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25df37e-63a2-4887-baa8-649703600350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:08.899740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b25df37e-63a2-4887-baa8-649703600350 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:08.931460 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:08.961212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25df37e-63a2-4887-baa8-649703600350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:08.962690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25df37e-63a2-4887-baa8-649703600350 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:08.971672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1298/2565] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:12.785679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0cc7f-0173-4a35-bfbd-08e1a7f8a8da service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:12.787134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c2b0cc7f-0173-4a35-bfbd-08e1a7f8a8da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:12.854252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0cc7f-0173-4a35-bfbd-08e1a7f8a8da service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:12.858834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:12.859470 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:12.859747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:12.860021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] PATH_INFO: `/v3/users/edf3990b04c84cf496616995b8a45885` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:12.861201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf3990b04c84cf496616995b8a45885)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:12.863921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:13.038264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf3990b04c84cf496616995b8a45885'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:13.038955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf3990b04c84cf496616995b8a45885'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:13.045999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf3990b04c84cf496616995b8a45885'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:13.046693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf3990b04c84cf496616995b8a45885'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:13.103973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf3990b04c84cf496616995b8a45885'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:13.123016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1268/2566] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:12 2022] DELETE /identity/v3/users/edf3990b04c84cf496616995b8a45885 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:13.127714 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e6f4d-74e4-4526-8553-64b358e04f14 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:13.128449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e6f4d-74e4-4526-8553-64b358e04f14 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:13.128449 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e6f4d-74e4-4526-8553-64b358e04f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:13.148042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-968e6f4d-74e4-4526-8553-64b358e04f14 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:13.149296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-968e6f4d-74e4-4526-8553-64b358e04f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:13.207911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1299/2567] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:13.217596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:13.219004 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:13.260013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:13.277362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9962a-17c4-49d5-93e5-3843bc0a707b admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:13.281311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fd237-0427-446f-adc6-07ab594a96d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:13.281926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fd237-0427-446f-adc6-07ab594a96d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:13.282200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fd237-0427-446f-adc6-07ab594a96d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:13.282511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fd237-0427-446f-adc6-07ab594a96d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:13.293129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fd237-0427-446f-adc6-07ab594a96d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:13.294593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fd237-0427-446f-adc6-07ab594a96d7 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:13.304588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1269/2568] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:13.724228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e6f4d-74e4-4526-8553-64b358e04f14 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:13.725796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-968e6f4d-74e4-4526-8553-64b358e04f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:13.739060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e6f4d-74e4-4526-8553-64b358e04f14 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:13.744757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:13.749831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:13.749831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:13.749831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] PATH_INFO: `/v3/projects/7507a44ee4eb495b8e480aa308a694e5` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:13.749831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7507a44ee4eb495b8e480aa308a694e5)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:13.749831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:13.872543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7507a44ee4eb495b8e480aa308a694e5', 'request_id': 'req-942fa40b-edc8-4a29-a496-465a20b9f579'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:13.880239 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7507a44ee4eb495b8e480aa308a694e5', 'request_id': 'req-942fa40b-edc8-4a29-a496-465a20b9f579'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:13.932906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7507a44ee4eb495b8e480aa308a694e5', 'request_id': 'req-942fa40b-edc8-4a29-a496-465a20b9f579'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:13.945368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] The token cache is being invalidate because project 7507a44ee4eb495b8e480aa308a694e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:13.946155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:13.946835 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:13.948405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1300/2569] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:13 2022] DELETE /identity/v3/projects/7507a44ee4eb495b8e480aa308a694e5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:13.952562 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fd237-0427-446f-adc6-07ab594a96d7 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:13.962617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fd237-0427-446f-adc6-07ab594a96d7 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:14.033379 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:14.036967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:14.036967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:14.036967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] PATH_INFO: `/v3/users/0d92be6428ce4315922f52fcfc51fbb8` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:14.036967 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d92be6428ce4315922f52fcfc51fbb8)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:14.037759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:14.238711 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d92be6428ce4315922f52fcfc51fbb8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:14.239302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d92be6428ce4315922f52fcfc51fbb8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:14.247420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d92be6428ce4315922f52fcfc51fbb8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:14.247420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d92be6428ce4315922f52fcfc51fbb8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:14.321425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d92be6428ce4315922f52fcfc51fbb8'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:14.340758 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1270/2570] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:13 2022] DELETE /identity/v3/users/0d92be6428ce4315922f52fcfc51fbb8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:14.813979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:14.816946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:14.831752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fa40b-edc8-4a29-a496-465a20b9f579 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:14.887682 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:14.896579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:14.897206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:14.897477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:14.897807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] PATH_INFO: `/v3/projects/63b464d0a1194469970536f7da6ac7e8` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:14.898919 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b464d0a1194469970536f7da6ac7e8)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:14.900808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:14.985119 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b464d0a1194469970536f7da6ac7e8', 'request_id': 'req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:14.992847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b464d0a1194469970536f7da6ac7e8', 'request_id': 'req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:15.053365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b464d0a1194469970536f7da6ac7e8', 'request_id': 'req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:15.068035 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] The token cache is being invalidate because project 63b464d0a1194469970536f7da6ac7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:15.068228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:15.068958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:15.070586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1301/2571] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:14 2022] DELETE /identity/v3/projects/63b464d0a1194469970536f7da6ac7e8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:15.075671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:15.078691 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:15.094291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad4beb-d25c-436c-b03b-810800a9ef12 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:15.150794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:15.162703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:15.162703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:15.162703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:15.162703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] PATH_INFO: `/v3/users/412f2a412de441ab80d320be55684fc5` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:15.163197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=412f2a412de441ab80d320be55684fc5)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:15.164054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:15.402273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412f2a412de441ab80d320be55684fc5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:15.402969 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412f2a412de441ab80d320be55684fc5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:15.414327 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412f2a412de441ab80d320be55684fc5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:15.416585 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412f2a412de441ab80d320be55684fc5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:15.493022 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-58f91b2b-ed07-4e58-8128-83a47dbb4d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412f2a412de441ab80d320be55684fc5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:15.513353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1271/2572] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:15 2022] DELETE /identity/v3/users/412f2a412de441ab80d320be55684fc5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:16.244292 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:16.245790 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:16.261323 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f31a8-d6e7-46b8-bebc-0e0762c351b8 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:16.338134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:16.338951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:16.339397 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:16.339528 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] PATH_INFO: `/v3/projects/417532a9b4d241c19d25e093f23fed30` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:16.341284 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=417532a9b4d241c19d25e093f23fed30)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:16.343253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:16.467829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417532a9b4d241c19d25e093f23fed30', 'request_id': 'req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:16.478059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417532a9b4d241c19d25e093f23fed30', 'request_id': 'req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:16.544448 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417532a9b4d241c19d25e093f23fed30', 'request_id': 'req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:16.558420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] The token cache is being invalidate because project 417532a9b4d241c19d25e093f23fed30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:16.558954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:16.566133 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c94a93f7-e0b0-4d40-86fa-4b808b12bb9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:16.567957 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1302/2573] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:16 2022] DELETE /identity/v3/projects/417532a9b4d241c19d25e093f23fed30 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:16.574026 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1c66-db42-4062-b195-467cb442437b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:16.574544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1c66-db42-4062-b195-467cb442437b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:16.574642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1c66-db42-4062-b195-467cb442437b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:16.600095 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c64d1c66-db42-4062-b195-467cb442437b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:16.602172 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c64d1c66-db42-4062-b195-467cb442437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:16.671758 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1272/2574] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:16.680242 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d505bdf-5f79-4f74-920b-0a9961d47e91 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:16.680522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d505bdf-5f79-4f74-920b-0a9961d47e91 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:16.680794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d505bdf-5f79-4f74-920b-0a9961d47e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:16.701831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-7d505bdf-5f79-4f74-920b-0a9961d47e91 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:16.703011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7d505bdf-5f79-4f74-920b-0a9961d47e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:16.711699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1303/2575] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:16.716029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d1c66-db42-4062-b195-467cb442437b None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:16.726727 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d1c66-db42-4062-b195-467cb442437b None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:16.731398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648acfa6-004b-4e0d-98f7-fac75e6490a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:16.732016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648acfa6-004b-4e0d-98f7-fac75e6490a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:16.732294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648acfa6-004b-4e0d-98f7-fac75e6490a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:16.732565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648acfa6-004b-4e0d-98f7-fac75e6490a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:16.733265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648acfa6-004b-4e0d-98f7-fac75e6490a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:33:16.733565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648acfa6-004b-4e0d-98f7-fac75e6490a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:16.735239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648acfa6-004b-4e0d-98f7-fac75e6490a8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:16.747216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1273/2576] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:33:16.755522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d505bdf-5f79-4f74-920b-0a9961d47e91 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:16.765147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d505bdf-5f79-4f74-920b-0a9961d47e91 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:16.770485 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff46bd-6922-4b9f-8161-e3cf8ed8dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:16.771270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff46bd-6922-4b9f-8161-e3cf8ed8dbbd admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:16.771401 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff46bd-6922-4b9f-8161-e3cf8ed8dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:16.771774 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff46bd-6922-4b9f-8161-e3cf8ed8dbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:16.772471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff46bd-6922-4b9f-8161-e3cf8ed8dbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:16.774357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff46bd-6922-4b9f-8161-e3cf8ed8dbbd admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:16.779289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:16.888644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1304/2577] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:16 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:16.892962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648acfa6-004b-4e0d-98f7-fac75e6490a8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:16.904354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648acfa6-004b-4e0d-98f7-fac75e6490a8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:16.972678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715937-37a3-4df2-ac5f-ca3de6894dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:16.973298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715937-37a3-4df2-ac5f-ca3de6894dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:16.973579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715937-37a3-4df2-ac5f-ca3de6894dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:16.973853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715937-37a3-4df2-ac5f-ca3de6894dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:16.974551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45715937-37a3-4df2-ac5f-ca3de6894dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:16.976467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45715937-37a3-4df2-ac5f-ca3de6894dc7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:16.986423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:17.105130 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1274/2578] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:16 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:17.109381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff46bd-6922-4b9f-8161-e3cf8ed8dbbd admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:17.120116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff46bd-6922-4b9f-8161-e3cf8ed8dbbd admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:17.124581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e31fa-a25e-438a-97b2-6e884c2b5e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:17.125180 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e31fa-a25e-438a-97b2-6e884c2b5e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.131236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e31fa-a25e-438a-97b2-6e884c2b5e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.131236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e31fa-a25e-438a-97b2-6e884c2b5e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.131236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e31fa-a25e-438a-97b2-6e884c2b5e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:17.131236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e31fa-a25e-438a-97b2-6e884c2b5e7d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:17.138701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1305/2579] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:33:17.143001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715937-37a3-4df2-ac5f-ca3de6894dc7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:17.153904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715937-37a3-4df2-ac5f-ca3de6894dc7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:17.160219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bbb68-0df1-4e0f-8d9e-4aa90d7f314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:17.160817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bbb68-0df1-4e0f-8d9e-4aa90d7f314a admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.161102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bbb68-0df1-4e0f-8d9e-4aa90d7f314a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.161361 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bbb68-0df1-4e0f-8d9e-4aa90d7f314a admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.162058 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bbb68-0df1-4e0f-8d9e-4aa90d7f314a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:17.163788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bbb68-0df1-4e0f-8d9e-4aa90d7f314a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:17.176657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1275/2580] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:33:17.181567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e31fa-a25e-438a-97b2-6e884c2b5e7d admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:17.192899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e31fa-a25e-438a-97b2-6e884c2b5e7d admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:17.197845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41198e0-3f49-4c3f-87f0-74879b6d38fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:17.198566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41198e0-3f49-4c3f-87f0-74879b6d38fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.198838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41198e0-3f49-4c3f-87f0-74879b6d38fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.199106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41198e0-3f49-4c3f-87f0-74879b6d38fd admin admin] PATH_INFO: `/v3/projects/4422092f032d45b1ad95cf95b4b1fbb3/users/769b57ba6564401f8dd79c49c0535845/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.215479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41198e0-3f49-4c3f-87f0-74879b6d38fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4422092f032d45b1ad95cf95b4b1fbb3, user_id=769b57ba6564401f8dd79c49c0535845, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:17.218095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41198e0-3f49-4c3f-87f0-74879b6d38fd admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:17.286990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1306/2581] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:17 2022] PUT /identity/v3/projects/4422092f032d45b1ad95cf95b4b1fbb3/users/769b57ba6564401f8dd79c49c0535845/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:17.300293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faf05e-2367-44fc-90ef-ab28ad6f9101 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.300644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faf05e-2367-44fc-90ef-ab28ad6f9101 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.300916 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faf05e-2367-44fc-90ef-ab28ad6f9101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.328930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-48faf05e-2367-44fc-90ef-ab28ad6f9101 None None] MFA Rules not processed for user `769b57ba6564401f8dd79c49c0535845`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:17.330199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-48faf05e-2367-44fc-90ef-ab28ad6f9101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:17.395595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1276/2582] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:17.399969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41198e0-3f49-4c3f-87f0-74879b6d38fd admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:17.410081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728fad0-e213-4883-a27e-5d0326da4655 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.410403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728fad0-e213-4883-a27e-5d0326da4655 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.410686 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728fad0-e213-4883-a27e-5d0326da4655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.441072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-a728fad0-e213-4883-a27e-5d0326da4655 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:17.444386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a728fad0-e213-4883-a27e-5d0326da4655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:17.472974 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41198e0-3f49-4c3f-87f0-74879b6d38fd admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:17.474474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0f5e7-85c2-4d12-aa88-909d3e73e3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:17.475087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0f5e7-85c2-4d12-aa88-909d3e73e3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.475368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0f5e7-85c2-4d12-aa88-909d3e73e3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.475640 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0f5e7-85c2-4d12-aa88-909d3e73e3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.476314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0f5e7-85c2-4d12-aa88-909d3e73e3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:17.478213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0f5e7-85c2-4d12-aa88-909d3e73e3e5 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:17.506434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1277/2583] 10.222.0.46 () {58 vars in 967 bytes} [Thu Aug 4 05:33:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:17.518949 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728fad0-e213-4883-a27e-5d0326da4655 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:17.520457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a728fad0-e213-4883-a27e-5d0326da4655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:17.561168 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1307/2584] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:17 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:17.562514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0f5e7-85c2-4d12-aa88-909d3e73e3e5 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:17.589359 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:17.594219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728fad0-e213-4883-a27e-5d0326da4655 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:17.635663 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0f5e7-85c2-4d12-aa88-909d3e73e3e5 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:17.641145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97d75-2e4c-4e46-a0a2-b5e127ca6452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:17.641770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97d75-2e4c-4e46-a0a2-b5e127ca6452 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.642048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97d75-2e4c-4e46-a0a2-b5e127ca6452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.642378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97d75-2e4c-4e46-a0a2-b5e127ca6452 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.643162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d97d75-2e4c-4e46-a0a2-b5e127ca6452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:17.645095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d97d75-2e4c-4e46-a0a2-b5e127ca6452 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:17.662936 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6851e6-7c2e-4f23-b5cd-4c63dd56e011 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:17.663563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6851e6-7c2e-4f23-b5cd-4c63dd56e011 service swift] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.663839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6851e6-7c2e-4f23-b5cd-4c63dd56e011 service swift] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.664107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6851e6-7c2e-4f23-b5cd-4c63dd56e011 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.726705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6851e6-7c2e-4f23-b5cd-4c63dd56e011 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:17.728318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6851e6-7c2e-4f23-b5cd-4c63dd56e011 service swift] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:17.743308 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1308/2585] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:17 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:33:17.743732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1278/2586] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:33:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 05:33:17.746268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97d75-2e4c-4e46-a0a2-b5e127ca6452 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:17.762034 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97d75-2e4c-4e46-a0a2-b5e127ca6452 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:17.764715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5425a6-9563-4dc9-bebb-ac24b0a3f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:17.765329 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5425a6-9563-4dc9-bebb-ac24b0a3f311 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.765607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5425a6-9563-4dc9-bebb-ac24b0a3f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.766454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5425a6-9563-4dc9-bebb-ac24b0a3f311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.766677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5425a6-9563-4dc9-bebb-ac24b0a3f311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:17.769212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5425a6-9563-4dc9-bebb-ac24b0a3f311 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:17.796469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1309/2587] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:17.796643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6851e6-7c2e-4f23-b5cd-4c63dd56e011 service swift] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:17.808024 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6851e6-7c2e-4f23-b5cd-4c63dd56e011 service swift] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:17.812887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5365a-2354-4a59-a4c6-efef980683ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:17.813526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5365a-2354-4a59-a4c6-efef980683ea admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.813792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5365a-2354-4a59-a4c6-efef980683ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.814069 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5365a-2354-4a59-a4c6-efef980683ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.815457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5365a-2354-4a59-a4c6-efef980683ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:17.817997 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5365a-2354-4a59-a4c6-efef980683ea admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:17.834184 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1279/2588] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:17.836050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5425a6-9563-4dc9-bebb-ac24b0a3f311 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:17.847216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5425a6-9563-4dc9-bebb-ac24b0a3f311 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:17.852225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89319f0f-1254-4f28-a1ca-29aaedb5429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:17.852885 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89319f0f-1254-4f28-a1ca-29aaedb5429d admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.853159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89319f0f-1254-4f28-a1ca-29aaedb5429d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.853439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89319f0f-1254-4f28-a1ca-29aaedb5429d admin admin] PATH_INFO: `/v3/projects/357b8095e9824f41825a81106a02b31e/users/9e337c0b7f1e4293bf88d0d08fd3420b/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.865203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:17.869610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89319f0f-1254-4f28-a1ca-29aaedb5429d admin admin] RBAC: Authorizing `identity:create_grant(project_id=357b8095e9824f41825a81106a02b31e, user_id=9e337c0b7f1e4293bf88d0d08fd3420b, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:17.873268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89319f0f-1254-4f28-a1ca-29aaedb5429d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:17.923803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1310/2589] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:17 2022] PUT /identity/v3/projects/357b8095e9824f41825a81106a02b31e/users/9e337c0b7f1e4293bf88d0d08fd3420b/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:17.934515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914475c-ee7c-47f1-9282-f3dc3d866866 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:17.934883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914475c-ee7c-47f1-9282-f3dc3d866866 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:17.935253 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914475c-ee7c-47f1-9282-f3dc3d866866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:17.965502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9914475c-ee7c-47f1-9282-f3dc3d866866 None None] MFA Rules not processed for user `9e337c0b7f1e4293bf88d0d08fd3420b`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:17.966858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9914475c-ee7c-47f1-9282-f3dc3d866866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:18.037013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1280/2590] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:18.041571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89319f0f-1254-4f28-a1ca-29aaedb5429d admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:18.112609 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89319f0f-1254-4f28-a1ca-29aaedb5429d admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:18.117245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d15bb-2ebd-47c0-b3ef-45cd053bce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:18.117850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d15bb-2ebd-47c0-b3ef-45cd053bce14 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:18.118123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d15bb-2ebd-47c0-b3ef-45cd053bce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:18.118422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d15bb-2ebd-47c0-b3ef-45cd053bce14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:18.119082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d15bb-2ebd-47c0-b3ef-45cd053bce14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:18.120968 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d15bb-2ebd-47c0-b3ef-45cd053bce14 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:18.209086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1311/2591] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:18 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:18.210196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914475c-ee7c-47f1-9282-f3dc3d866866 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:18.221922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914475c-ee7c-47f1-9282-f3dc3d866866 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:18.254003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:18.312919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542726-1f1b-4711-bfd3-71b7402b580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:18.314067 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542726-1f1b-4711-bfd3-71b7402b580f admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:18.314580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542726-1f1b-4711-bfd3-71b7402b580f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:18.315593 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542726-1f1b-4711-bfd3-71b7402b580f admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:18.316773 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a542726-1f1b-4711-bfd3-71b7402b580f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:18.320363 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a542726-1f1b-4711-bfd3-71b7402b580f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:18.446519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1281/2592] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:18 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:33:18.449908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d15bb-2ebd-47c0-b3ef-45cd053bce14 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:18.460471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d15bb-2ebd-47c0-b3ef-45cd053bce14 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:18.465299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b737f0-2d30-4677-aa01-3e76c4df1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:18.465941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b737f0-2d30-4677-aa01-3e76c4df1a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:18.466197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b737f0-2d30-4677-aa01-3e76c4df1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:18.466495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b737f0-2d30-4677-aa01-3e76c4df1a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:18.467174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b737f0-2d30-4677-aa01-3e76c4df1a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:18.468747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b737f0-2d30-4677-aa01-3e76c4df1a98 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:18.479951 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1312/2593] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:18.484303 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542726-1f1b-4711-bfd3-71b7402b580f admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:18.495246 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542726-1f1b-4711-bfd3-71b7402b580f admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:18.500045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09241425-1eef-42ae-aec9-f0fc6a2ceb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:18.500730 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09241425-1eef-42ae-aec9-f0fc6a2ceb8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:18.501012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09241425-1eef-42ae-aec9-f0fc6a2ceb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:18.501287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09241425-1eef-42ae-aec9-f0fc6a2ceb8a admin admin] PATH_INFO: `/v3/projects/bea73746dc7a4405a6d00d8edab82938/users/e80ebbdc4edd47a69637ac0bb305dee9/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:18.518676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09241425-1eef-42ae-aec9-f0fc6a2ceb8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea73746dc7a4405a6d00d8edab82938, user_id=e80ebbdc4edd47a69637ac0bb305dee9, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:18.521408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09241425-1eef-42ae-aec9-f0fc6a2ceb8a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:18.624539 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1282/2594] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:18 2022] PUT /identity/v3/projects/bea73746dc7a4405a6d00d8edab82938/users/e80ebbdc4edd47a69637ac0bb305dee9/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:18.631620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b737f0-2d30-4677-aa01-3e76c4df1a98 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:18.644245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b737f0-2d30-4677-aa01-3e76c4df1a98 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:18.704689 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23558f-90cb-494d-a047-19558da07be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:18.705452 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23558f-90cb-494d-a047-19558da07be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:18.705904 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23558f-90cb-494d-a047-19558da07be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:18.706462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23558f-90cb-494d-a047-19558da07be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:18.707276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23558f-90cb-494d-a047-19558da07be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:18.708969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23558f-90cb-494d-a047-19558da07be1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:18.719193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1313/2595] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:18.728773 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09241425-1eef-42ae-aec9-f0fc6a2ceb8a admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:18.741256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09241425-1eef-42ae-aec9-f0fc6a2ceb8a admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:18.746537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecb367-4f23-4038-adfb-69e7126e7de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:18.747205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecb367-4f23-4038-adfb-69e7126e7de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:18.747479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecb367-4f23-4038-adfb-69e7126e7de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:18.747747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecb367-4f23-4038-adfb-69e7126e7de3 admin admin] PATH_INFO: `/v3/projects/bea73746dc7a4405a6d00d8edab82938/users/e80ebbdc4edd47a69637ac0bb305dee9/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:18.749717 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecb367-4f23-4038-adfb-69e7126e7de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea73746dc7a4405a6d00d8edab82938, user_id=e80ebbdc4edd47a69637ac0bb305dee9, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:18.753020 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecb367-4f23-4038-adfb-69e7126e7de3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:18.764448 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1283/2596] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:18 2022] PUT /identity/v3/projects/bea73746dc7a4405a6d00d8edab82938/users/e80ebbdc4edd47a69637ac0bb305dee9/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:18.776173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff464ee8-8b1c-4115-aa0e-75aa934099fc None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:18.776587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff464ee8-8b1c-4115-aa0e-75aa934099fc None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:18.776887 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff464ee8-8b1c-4115-aa0e-75aa934099fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:18.806931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ff464ee8-8b1c-4115-aa0e-75aa934099fc None None] MFA Rules not processed for user `e80ebbdc4edd47a69637ac0bb305dee9`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:18.808123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ff464ee8-8b1c-4115-aa0e-75aa934099fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:18.857725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:18.883129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1314/2597] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:18.896260 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecb367-4f23-4038-adfb-69e7126e7de3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:18.898060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0aecb367-4f23-4038-adfb-69e7126e7de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:18.954293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff464ee8-8b1c-4115-aa0e-75aa934099fc None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:18.956654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ff464ee8-8b1c-4115-aa0e-75aa934099fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:18.991076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecb367-4f23-4038-adfb-69e7126e7de3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:18.995059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ceec8-f502-432c-aa8c-8cb3396bb8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:18.995620 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ceec8-f502-432c-aa8c-8cb3396bb8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:18.995898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ceec8-f502-432c-aa8c-8cb3396bb8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:18.996170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ceec8-f502-432c-aa8c-8cb3396bb8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:19.006962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ceec8-f502-432c-aa8c-8cb3396bb8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:19.008475 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ceec8-f502-432c-aa8c-8cb3396bb8b2 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:19.018772 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1284/2598] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:19.029799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff464ee8-8b1c-4115-aa0e-75aa934099fc None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:19.035342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:19.035984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:19.036262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:19.036535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] PATH_INFO: `/v3/users/40abc905f0a241ad9c2194590b21e0f9` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:19.037749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40abc905f0a241ad9c2194590b21e0f9)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:19.039701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:19.128698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ceec8-f502-432c-aa8c-8cb3396bb8b2 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:19.130115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-713ceec8-f502-432c-aa8c-8cb3396bb8b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:19.141513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ceec8-f502-432c-aa8c-8cb3396bb8b2 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:19.146119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599e7bd-e574-4121-b9d7-aa63a321080c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:19.146836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e7bd-e574-4121-b9d7-aa63a321080c service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:19.147190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e7bd-e574-4121-b9d7-aa63a321080c service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:19.147468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e7bd-e574-4121-b9d7-aa63a321080c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:19.207495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599e7bd-e574-4121-b9d7-aa63a321080c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:19.209168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599e7bd-e574-4121-b9d7-aa63a321080c service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:19.218637 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1285/2599] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:33:19.255722 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40abc905f0a241ad9c2194590b21e0f9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:19.256541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40abc905f0a241ad9c2194590b21e0f9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:19.263870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40abc905f0a241ad9c2194590b21e0f9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:19.276273 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40abc905f0a241ad9c2194590b21e0f9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:19.372510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40abc905f0a241ad9c2194590b21e0f9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:19.379240 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1315/2600] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:18 2022] DELETE /identity/v3/users/40abc905f0a241ad9c2194590b21e0f9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:19.384063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16091f1e-d529-48c2-aee5-e3d0cb620018 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:19.384351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16091f1e-d529-48c2-aee5-e3d0cb620018 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:19.384635 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16091f1e-d529-48c2-aee5-e3d0cb620018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:19.405487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-16091f1e-d529-48c2-aee5-e3d0cb620018 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:19.406583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-16091f1e-d529-48c2-aee5-e3d0cb620018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:19.419118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:19.467142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1286/2601] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:19.477561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:19.479019 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:19.536939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd8c99-fff1-4532-9d36-eff95c29a219 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:19.540578 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e5ef4-4bbd-45f9-a373-21b3504b1204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:19.541219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5ef4-4bbd-45f9-a373-21b3504b1204 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:19.541493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5ef4-4bbd-45f9-a373-21b3504b1204 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:19.541780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e5ef4-4bbd-45f9-a373-21b3504b1204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:19.551202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e5ef4-4bbd-45f9-a373-21b3504b1204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:19.552677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e5ef4-4bbd-45f9-a373-21b3504b1204 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:19.563530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1316/2602] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:19.985108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16091f1e-d529-48c2-aee5-e3d0cb620018 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:19.989638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-16091f1e-d529-48c2-aee5-e3d0cb620018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:20.015114 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16091f1e-d529-48c2-aee5-e3d0cb620018 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:20.020698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:20.021707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:20.022185 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:20.022712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] PATH_INFO: `/v3/projects/93db3919d1de430db2264961580931c5` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:20.024161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93db3919d1de430db2264961580931c5)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:20.026408 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:20.135499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93db3919d1de430db2264961580931c5', 'request_id': 'req-610e3124-ecd4-490f-96ab-7826000a9aa4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:20.146920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93db3919d1de430db2264961580931c5', 'request_id': 'req-610e3124-ecd4-490f-96ab-7826000a9aa4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:20.241554 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93db3919d1de430db2264961580931c5', 'request_id': 'req-610e3124-ecd4-490f-96ab-7826000a9aa4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:20.253274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] The token cache is being invalidate because project 93db3919d1de430db2264961580931c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:20.253563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:20.254198 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:20.255738 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1287/2603] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:19 2022] DELETE /identity/v3/projects/93db3919d1de430db2264961580931c5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:20.259813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e5ef4-4bbd-45f9-a373-21b3504b1204 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:20.269967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e5ef4-4bbd-45f9-a373-21b3504b1204 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:20.273595 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:20.327416 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:20.327958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:20.328236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:20.328502 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] PATH_INFO: `/v3/users/09e5ed5ecc5941a1a11529cd59012a87` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:20.329726 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e5ed5ecc5941a1a11529cd59012a87)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:20.331744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:20.511708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e5ed5ecc5941a1a11529cd59012a87'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:20.512359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e5ed5ecc5941a1a11529cd59012a87'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:20.519546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e5ed5ecc5941a1a11529cd59012a87'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:20.531863 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e5ed5ecc5941a1a11529cd59012a87'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:20.623616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-39fdd27f-30dc-443a-bd56-128bb2ad9a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e5ed5ecc5941a1a11529cd59012a87'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:20.630149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1317/2604] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:20 2022] DELETE /identity/v3/users/09e5ed5ecc5941a1a11529cd59012a87 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:21.265857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:21.267409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:21.281551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e3124-ecd4-490f-96ab-7826000a9aa4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:21.344080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:21.344719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:21.344996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:21.345268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] PATH_INFO: `/v3/projects/f6b80713be0540c8a41b1289cc0da59d` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:21.346975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b80713be0540c8a41b1289cc0da59d)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:21.348971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:21.451550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:21.455210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b80713be0540c8a41b1289cc0da59d', 'request_id': 'req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:21.462087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b80713be0540c8a41b1289cc0da59d', 'request_id': 'req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:21.555433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b80713be0540c8a41b1289cc0da59d', 'request_id': 'req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:21.567561 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] The token cache is being invalidate because project f6b80713be0540c8a41b1289cc0da59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:21.567852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:21.568507 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-6cf35391-208c-4fc6-bcb6-9a994bdb0e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:21.570660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1288/2605] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:21 2022] DELETE /identity/v3/projects/f6b80713be0540c8a41b1289cc0da59d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:21.575081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c3a20-283c-4652-8034-bb96f1ca390c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:21.575580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c3a20-283c-4652-8034-bb96f1ca390c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:21.575698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c3a20-283c-4652-8034-bb96f1ca390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:21.596749 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-653c3a20-283c-4652-8034-bb96f1ca390c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:21.597976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-653c3a20-283c-4652-8034-bb96f1ca390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:21.656136 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1318/2606] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:21.663941 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7003c-4ec0-4916-9324-8854096a8f40 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:21.664252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7003c-4ec0-4916-9324-8854096a8f40 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:21.664559 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7003c-4ec0-4916-9324-8854096a8f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:21.684831 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-5cb7003c-4ec0-4916-9324-8854096a8f40 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:21.685955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5cb7003c-4ec0-4916-9324-8854096a8f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:21.694693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1289/2607] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:21.699011 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c3a20-283c-4652-8034-bb96f1ca390c None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:21.708744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c3a20-283c-4652-8034-bb96f1ca390c None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:21.713301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa247c-73e4-4189-a16c-67644af04ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:21.713941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa247c-73e4-4189-a16c-67644af04ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:21.714210 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa247c-73e4-4189-a16c-67644af04ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:21.714511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa247c-73e4-4189-a16c-67644af04ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:21.715197 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa247c-73e4-4189-a16c-67644af04ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:33:21.715493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa247c-73e4-4189-a16c-67644af04ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:21.717061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa247c-73e4-4189-a16c-67644af04ccc admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:21.730865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1319/2608] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:33:21.739182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7003c-4ec0-4916-9324-8854096a8f40 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:21.748511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7003c-4ec0-4916-9324-8854096a8f40 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:21.753980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9ff05-df70-4190-8a37-390d1160a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:21.754630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9ff05-df70-4190-8a37-390d1160a299 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:21.754906 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9ff05-df70-4190-8a37-390d1160a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:21.755177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9ff05-df70-4190-8a37-390d1160a299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:21.755840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9ff05-df70-4190-8a37-390d1160a299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:21.757739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9ff05-df70-4190-8a37-390d1160a299 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:21.849296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1290/2609] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:21 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:21.854203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa247c-73e4-4189-a16c-67644af04ccc admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:21.865402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa247c-73e4-4189-a16c-67644af04ccc admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:21.874907 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:21.925658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cab67-7a6a-43c5-99d0-f36ec0e83a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:21.926479 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cab67-7a6a-43c5-99d0-f36ec0e83a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:21.927000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cab67-7a6a-43c5-99d0-f36ec0e83a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:21.927620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cab67-7a6a-43c5-99d0-f36ec0e83a58 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:21.928405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6cab67-7a6a-43c5-99d0-f36ec0e83a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:21.930439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6cab67-7a6a-43c5-99d0-f36ec0e83a58 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:21.996228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1320/2610] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:21 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:33:22.000677 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9ff05-df70-4190-8a37-390d1160a299 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:22.011418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9ff05-df70-4190-8a37-390d1160a299 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:22.016102 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aa9a6-f916-4b0d-a87f-8457c73997a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:22.016706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aa9a6-f916-4b0d-a87f-8457c73997a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:22.016977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aa9a6-f916-4b0d-a87f-8457c73997a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:22.017247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aa9a6-f916-4b0d-a87f-8457c73997a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:22.017933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aa9a6-f916-4b0d-a87f-8457c73997a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:22.019751 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aa9a6-f916-4b0d-a87f-8457c73997a7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:22.030256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1291/2611] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:22.035587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cab67-7a6a-43c5-99d0-f36ec0e83a58 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:22.051772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cab67-7a6a-43c5-99d0-f36ec0e83a58 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:22.057288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc869b19-eac1-4cd5-95ad-06abcc842705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:22.058192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc869b19-eac1-4cd5-95ad-06abcc842705 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:22.058553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc869b19-eac1-4cd5-95ad-06abcc842705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:22.059151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc869b19-eac1-4cd5-95ad-06abcc842705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:22.060219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc869b19-eac1-4cd5-95ad-06abcc842705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:22.062597 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc869b19-eac1-4cd5-95ad-06abcc842705 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:22.074080 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1321/2612] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:22.078297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aa9a6-f916-4b0d-a87f-8457c73997a7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:22.088631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aa9a6-f916-4b0d-a87f-8457c73997a7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:22.093433 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aef092-7ca7-4d35-aa90-ea7637d02fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:22.094086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef092-7ca7-4d35-aa90-ea7637d02fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:22.094404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef092-7ca7-4d35-aa90-ea7637d02fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:22.094723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef092-7ca7-4d35-aa90-ea7637d02fad admin admin] PATH_INFO: `/v3/projects/94553155e0d04ccea1160e02a3e88c09/users/91d536a0fea84556bf32dfae6b1291a8/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:22.109937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aef092-7ca7-4d35-aa90-ea7637d02fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=94553155e0d04ccea1160e02a3e88c09, user_id=91d536a0fea84556bf32dfae6b1291a8, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:22.113281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aef092-7ca7-4d35-aa90-ea7637d02fad admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:22.218519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1292/2613] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:22 2022] PUT /identity/v3/projects/94553155e0d04ccea1160e02a3e88c09/users/91d536a0fea84556bf32dfae6b1291a8/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:22.230053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee621d-7104-4a13-9149-4af3d7b01fa3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:22.230354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee621d-7104-4a13-9149-4af3d7b01fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:22.230629 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee621d-7104-4a13-9149-4af3d7b01fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:22.259105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ebee621d-7104-4a13-9149-4af3d7b01fa3 None None] MFA Rules not processed for user `91d536a0fea84556bf32dfae6b1291a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:22.260218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ebee621d-7104-4a13-9149-4af3d7b01fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:22.326786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1322/2614] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:22.339116 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aef092-7ca7-4d35-aa90-ea7637d02fad admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:22.340973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d8aef092-7ca7-4d35-aa90-ea7637d02fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:22.400209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aef092-7ca7-4d35-aa90-ea7637d02fad admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:22.404302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd7266-9b13-432b-8d51-a98874b9d130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:22.404918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7266-9b13-432b-8d51-a98874b9d130 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:22.405196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7266-9b13-432b-8d51-a98874b9d130 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:22.405474 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7266-9b13-432b-8d51-a98874b9d130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:22.414621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd7266-9b13-432b-8d51-a98874b9d130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:22.416033 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd7266-9b13-432b-8d51-a98874b9d130 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:22.425448 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1293/2615] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:23.245922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee621d-7104-4a13-9149-4af3d7b01fa3 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:23.248454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ebee621d-7104-4a13-9149-4af3d7b01fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:23.317303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee621d-7104-4a13-9149-4af3d7b01fa3 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:23.321954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:23.322621 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:23.323003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:23.323182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] PATH_INFO: `/v3/users/769b57ba6564401f8dd79c49c0535845` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:23.324340 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] RBAC: Authorizing `identity:delete_user(user_id=769b57ba6564401f8dd79c49c0535845)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:23.326827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:23.350440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:23.518370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769b57ba6564401f8dd79c49c0535845'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:23.519182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769b57ba6564401f8dd79c49c0535845'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:23.526207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769b57ba6564401f8dd79c49c0535845'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:23.539470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769b57ba6564401f8dd79c49c0535845'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:23.646752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769b57ba6564401f8dd79c49c0535845'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:23.653584 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1323/2616] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:23 2022] DELETE /identity/v3/users/769b57ba6564401f8dd79c49c0535845 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:23.658112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fb06-3a53-44fd-8edb-fe425e954a38 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:23.659147 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fb06-3a53-44fd-8edb-fe425e954a38 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:23.659310 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930fb06-3a53-44fd-8edb-fe425e954a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:23.678905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8930fb06-3a53-44fd-8edb-fe425e954a38 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:23.680107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8930fb06-3a53-44fd-8edb-fe425e954a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:23.739888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1294/2617] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:23.749660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:23.751055 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:23.833017 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f637945-ba67-4847-a350-cc3c8806805d admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:23.836708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe35f90-246c-4f32-a681-10ed68cdc830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:23.839777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe35f90-246c-4f32-a681-10ed68cdc830 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:23.839777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe35f90-246c-4f32-a681-10ed68cdc830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:23.839777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe35f90-246c-4f32-a681-10ed68cdc830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:23.848279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe35f90-246c-4f32-a681-10ed68cdc830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:23.849730 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe35f90-246c-4f32-a681-10ed68cdc830 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:23.860068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1324/2618] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:24.300382 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930fb06-3a53-44fd-8edb-fe425e954a38 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:24.301911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8930fb06-3a53-44fd-8edb-fe425e954a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:24.321137 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930fb06-3a53-44fd-8edb-fe425e954a38 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:24.326238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:24.326921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:24.327276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:24.327450 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] PATH_INFO: `/v3/projects/4422092f032d45b1ad95cf95b4b1fbb3` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:24.328612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4422092f032d45b1ad95cf95b4b1fbb3)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:24.331154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:24.337963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:24.455908 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4422092f032d45b1ad95cf95b4b1fbb3', 'request_id': 'req-43f033ea-42a9-48a2-ba59-6ae8567855d9'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:24.462296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4422092f032d45b1ad95cf95b4b1fbb3', 'request_id': 'req-43f033ea-42a9-48a2-ba59-6ae8567855d9'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:24.520644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4422092f032d45b1ad95cf95b4b1fbb3', 'request_id': 'req-43f033ea-42a9-48a2-ba59-6ae8567855d9'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:24.532675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] The token cache is being invalidate because project 4422092f032d45b1ad95cf95b4b1fbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:24.532965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:24.533652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:24.535280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1295/2619] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:24 2022] DELETE /identity/v3/projects/4422092f032d45b1ad95cf95b4b1fbb3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:24.539287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe35f90-246c-4f32-a681-10ed68cdc830 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:24.549956 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe35f90-246c-4f32-a681-10ed68cdc830 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:24.609006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:24.609646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:24.609923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:24.610222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] PATH_INFO: `/v3/users/9e337c0b7f1e4293bf88d0d08fd3420b` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:24.611408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e337c0b7f1e4293bf88d0d08fd3420b)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:24.613868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:24.704564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:24.849317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e337c0b7f1e4293bf88d0d08fd3420b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:24.849882 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e337c0b7f1e4293bf88d0d08fd3420b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:24.856872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e337c0b7f1e4293bf88d0d08fd3420b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:24.869921 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e337c0b7f1e4293bf88d0d08fd3420b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:24.990392 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e337c0b7f1e4293bf88d0d08fd3420b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:24.997093 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1325/2620] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:24 2022] DELETE /identity/v3/users/9e337c0b7f1e4293bf88d0d08fd3420b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:25.438067 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:25.438893 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:25.453503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f033ea-42a9-48a2-ba59-6ae8567855d9 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:25.510508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:25.511149 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:25.511425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:25.511697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] PATH_INFO: `/v3/projects/357b8095e9824f41825a81106a02b31e` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:25.512843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357b8095e9824f41825a81106a02b31e)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:25.514790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:25.624213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357b8095e9824f41825a81106a02b31e', 'request_id': 'req-4cec849d-94c2-46bd-bccf-d74dc6629797'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:25.630891 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357b8095e9824f41825a81106a02b31e', 'request_id': 'req-4cec849d-94c2-46bd-bccf-d74dc6629797'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:25.709339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357b8095e9824f41825a81106a02b31e', 'request_id': 'req-4cec849d-94c2-46bd-bccf-d74dc6629797'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:25.720832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] The token cache is being invalidate because project 357b8095e9824f41825a81106a02b31e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:25.721671 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:25.725096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:25.725096 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1296/2621] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:25 2022] DELETE /identity/v3/projects/357b8095e9824f41825a81106a02b31e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:25.728126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:25.729550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:25.743036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e53e9-64c8-4b04-a42c-df65720d50cf admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:25.798611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:25.799771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:25.800103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:25.800369 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] PATH_INFO: `/v3/users/e80ebbdc4edd47a69637ac0bb305dee9` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:25.801523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80ebbdc4edd47a69637ac0bb305dee9)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:25.803457 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:25.976289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80ebbdc4edd47a69637ac0bb305dee9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:25.976941 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80ebbdc4edd47a69637ac0bb305dee9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:25.983821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80ebbdc4edd47a69637ac0bb305dee9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:25.995838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80ebbdc4edd47a69637ac0bb305dee9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.086423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80ebbdc4edd47a69637ac0bb305dee9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.092679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1326/2622] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:25 2022] DELETE /identity/v3/users/e80ebbdc4edd47a69637ac0bb305dee9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:26.480339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:26.480339 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:26.493058 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:26.494575 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:26.504868 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec849d-94c2-46bd-bccf-d74dc6629797 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:26.527746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:26.529044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:26.567797 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:26.568447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:26.568735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:26.569006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] PATH_INFO: `/v3/projects/bea73746dc7a4405a6d00d8edab82938` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:26.570170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea73746dc7a4405a6d00d8edab82938)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:26.570294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ad825-8b9c-4aac-84a9-d38c1275937d admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:26.572244 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:26.575333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:26.575961 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:26.576236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:26.576508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] PATH_INFO: `/v3/users/91d536a0fea84556bf32dfae6b1291a8` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:26.577820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d536a0fea84556bf32dfae6b1291a8)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:26.579659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:26.658431 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea73746dc7a4405a6d00d8edab82938', 'request_id': 'req-431201bb-895b-493d-bc9d-8ab1eb3c20bf'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.665604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea73746dc7a4405a6d00d8edab82938', 'request_id': 'req-431201bb-895b-493d-bc9d-8ab1eb3c20bf'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.772714 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea73746dc7a4405a6d00d8edab82938', 'request_id': 'req-431201bb-895b-493d-bc9d-8ab1eb3c20bf'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.785499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] The token cache is being invalidate because project bea73746dc7a4405a6d00d8edab82938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:26.786005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.786468 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-431201bb-895b-493d-bc9d-8ab1eb3c20bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.787390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d536a0fea84556bf32dfae6b1291a8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.787983 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1297/2623] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:26 2022] DELETE /identity/v3/projects/bea73746dc7a4405a6d00d8edab82938 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:26.788099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d536a0fea84556bf32dfae6b1291a8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.793801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702c5f-531b-45e9-99b8-9c68236ca434 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:26.795268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702c5f-531b-45e9-99b8-9c68236ca434 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:26.795268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702c5f-531b-45e9-99b8-9c68236ca434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:26.795545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d536a0fea84556bf32dfae6b1291a8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.807765 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d536a0fea84556bf32dfae6b1291a8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.813852 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9a702c5f-531b-45e9-99b8-9c68236ca434 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:26.815142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9a702c5f-531b-45e9-99b8-9c68236ca434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:26.874955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1298/2624] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:26.884023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff533c-9244-4bb3-b120-9e3410f6f337 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:26.884308 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff533c-9244-4bb3-b120-9e3410f6f337 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:26.884665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff533c-9244-4bb3-b120-9e3410f6f337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:26.897807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2732715b-cdd1-40d8-b7d3-27b89918b80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d536a0fea84556bf32dfae6b1291a8'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:26.904862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1327/2625] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:26 2022] DELETE /identity/v3/users/91d536a0fea84556bf32dfae6b1291a8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:26.905498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-efff533c-9244-4bb3-b120-9e3410f6f337 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:26.906742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-efff533c-9244-4bb3-b120-9e3410f6f337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:26.912374 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852c0c-a0bd-41c8-ada5-6915f622aa34 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:26.912672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852c0c-a0bd-41c8-ada5-6915f622aa34 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:26.912947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852c0c-a0bd-41c8-ada5-6915f622aa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:26.933527 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-00852c0c-a0bd-41c8-ada5-6915f622aa34 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:26.934769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-00852c0c-a0bd-41c8-ada5-6915f622aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:26.970436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1299/2626] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:26.975061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff533c-9244-4bb3-b120-9e3410f6f337 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:26.984871 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff533c-9244-4bb3-b120-9e3410f6f337 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:26.990183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f251dbe-b2f8-415b-91ad-92f498dbf6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:26.990830 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f251dbe-b2f8-415b-91ad-92f498dbf6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:26.991115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f251dbe-b2f8-415b-91ad-92f498dbf6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:26.991393 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f251dbe-b2f8-415b-91ad-92f498dbf6c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:26.992091 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f251dbe-b2f8-415b-91ad-92f498dbf6c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:33:26.992394 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f251dbe-b2f8-415b-91ad-92f498dbf6c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:26.994103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f251dbe-b2f8-415b-91ad-92f498dbf6c5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:26.996311 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1328/2627] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:27.003663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:27.007154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00852c0c-a0bd-41c8-ada5-6915f622aa34 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.008813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-00852c0c-a0bd-41c8-ada5-6915f622aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:27.010546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1300/2628] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:33:27.015296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f251dbe-b2f8-415b-91ad-92f498dbf6c5 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.025576 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f251dbe-b2f8-415b-91ad-92f498dbf6c5 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.030811 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b2c98-f848-4f1c-9418-1b395b3eec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.031415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b2c98-f848-4f1c-9418-1b395b3eec8c admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.031706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b2c98-f848-4f1c-9418-1b395b3eec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.031982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b2c98-f848-4f1c-9418-1b395b3eec8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.032646 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b2c98-f848-4f1c-9418-1b395b3eec8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.034821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b2c98-f848-4f1c-9418-1b395b3eec8c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.057558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:27.069924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00852c0c-a0bd-41c8-ada5-6915f622aa34 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.073582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880b3c1-bfbc-4985-b205-9267007eeada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.074192 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880b3c1-bfbc-4985-b205-9267007eeada service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.074495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880b3c1-bfbc-4985-b205-9267007eeada service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.074766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880b3c1-bfbc-4985-b205-9267007eeada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.083992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880b3c1-bfbc-4985-b205-9267007eeada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.085463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880b3c1-bfbc-4985-b205-9267007eeada service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.094966 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1329/2629] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:33:27.103719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1301/2630] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:27 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:27.129145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880b3c1-bfbc-4985-b205-9267007eeada service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.129145 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880b3c1-bfbc-4985-b205-9267007eeada service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.179861 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7f34d-3462-4351-b159-1b105f11f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.180505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7f34d-3462-4351-b159-1b105f11f566 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.180837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7f34d-3462-4351-b159-1b105f11f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.181111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7f34d-3462-4351-b159-1b105f11f566 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.181770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7f34d-3462-4351-b159-1b105f11f566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.183709 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7f34d-3462-4351-b159-1b105f11f566 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.276191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1330/2631] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:27 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:33:27.280947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b2c98-f848-4f1c-9418-1b395b3eec8c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.291903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b2c98-f848-4f1c-9418-1b395b3eec8c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.297268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc2f1a-ab76-4b40-bf4a-7494a78d73d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.301388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc2f1a-ab76-4b40-bf4a-7494a78d73d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.301388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc2f1a-ab76-4b40-bf4a-7494a78d73d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.301388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc2f1a-ab76-4b40-bf4a-7494a78d73d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.301388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc2f1a-ab76-4b40-bf4a-7494a78d73d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.301768 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc2f1a-ab76-4b40-bf4a-7494a78d73d8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.315534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1302/2632] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:27.316315 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7f34d-3462-4351-b159-1b105f11f566 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.329903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7f34d-3462-4351-b159-1b105f11f566 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.335977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830c3ef-52dc-4bda-ab61-0a358dc545e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.336917 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830c3ef-52dc-4bda-ab61-0a358dc545e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.337265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830c3ef-52dc-4bda-ab61-0a358dc545e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.337776 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830c3ef-52dc-4bda-ab61-0a358dc545e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.338593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830c3ef-52dc-4bda-ab61-0a358dc545e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.340420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830c3ef-52dc-4bda-ab61-0a358dc545e6 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.355543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1331/2633] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:27.356901 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc2f1a-ab76-4b40-bf4a-7494a78d73d8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.367957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc2f1a-ab76-4b40-bf4a-7494a78d73d8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.372841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ef52-15c7-4365-a62f-c7fdcfecf7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.373508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ef52-15c7-4365-a62f-c7fdcfecf7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.373786 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ef52-15c7-4365-a62f-c7fdcfecf7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.374063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ef52-15c7-4365-a62f-c7fdcfecf7ac admin admin] PATH_INFO: `/v3/projects/c2a819899f574b22a29202ec2e83d348/users/276a3676574d45eeb8abd3a6b520a7a5/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.389722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ef52-15c7-4365-a62f-c7fdcfecf7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a819899f574b22a29202ec2e83d348, user_id=276a3676574d45eeb8abd3a6b520a7a5, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.392457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ef52-15c7-4365-a62f-c7fdcfecf7ac admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.453154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1303/2634] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:27 2022] PUT /identity/v3/projects/c2a819899f574b22a29202ec2e83d348/users/276a3676574d45eeb8abd3a6b520a7a5/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:27.464821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465453-e823-4278-80f9-97d189fbe89e None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.465103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465453-e823-4278-80f9-97d189fbe89e None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.465377 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465453-e823-4278-80f9-97d189fbe89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.493517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-d2465453-e823-4278-80f9-97d189fbe89e None None] MFA Rules not processed for user `276a3676574d45eeb8abd3a6b520a7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:27.494822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d2465453-e823-4278-80f9-97d189fbe89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:27.500311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ef52-15c7-4365-a62f-c7fdcfecf7ac admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.502265 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-5040ef52-15c7-4365-a62f-c7fdcfecf7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:27.571769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1332/2635] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:27.576123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2465453-e823-4278-80f9-97d189fbe89e None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.576369 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ef52-15c7-4365-a62f-c7fdcfecf7ac admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.581952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.582606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.582902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.583160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] PATH_INFO: `/v3/projects/94553155e0d04ccea1160e02a3e88c09` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.584353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94553155e0d04ccea1160e02a3e88c09)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.586299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.587589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2465453-e823-4278-80f9-97d189fbe89e None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.592367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4d27d-a682-4017-bdee-7b49ecd12ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.592957 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d27d-a682-4017-bdee-7b49ecd12ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.593230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d27d-a682-4017-bdee-7b49ecd12ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.593493 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d27d-a682-4017-bdee-7b49ecd12ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.594140 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4d27d-a682-4017-bdee-7b49ecd12ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.596602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4d27d-a682-4017-bdee-7b49ecd12ccf admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.680924 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94553155e0d04ccea1160e02a3e88c09', 'request_id': 'req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:27.682701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1333/2636] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:27 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:33:27.686642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4d27d-a682-4017-bdee-7b49ecd12ccf admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.687603 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94553155e0d04ccea1160e02a3e88c09', 'request_id': 'req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:27.720524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:27.743819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94553155e0d04ccea1160e02a3e88c09', 'request_id': 'req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:27.749900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4d27d-a682-4017-bdee-7b49ecd12ccf admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.755182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76505368-4d53-4106-8b03-b5f998027496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.758007 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76505368-4d53-4106-8b03-b5f998027496 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.758124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] The token cache is being invalidate because project 94553155e0d04ccea1160e02a3e88c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:27.758124 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:27.758400 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76505368-4d53-4106-8b03-b5f998027496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.758524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-d54d81b4-b0b2-4ae9-b660-0fa4ec6d4578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:27.758628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76505368-4d53-4106-8b03-b5f998027496 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.758628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76505368-4d53-4106-8b03-b5f998027496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.759446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76505368-4d53-4106-8b03-b5f998027496 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.761932 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1304/2637] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:27 2022] DELETE /identity/v3/projects/94553155e0d04ccea1160e02a3e88c09 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:27.763257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfca1d7-8148-49e6-b37e-ea92efe325ee None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.763542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfca1d7-8148-49e6-b37e-ea92efe325ee None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.763844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfca1d7-8148-49e6-b37e-ea92efe325ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.784794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9dfca1d7-8148-49e6-b37e-ea92efe325ee None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:27.785913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9dfca1d7-8148-49e6-b37e-ea92efe325ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:27.794077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1305/2638] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:27.804918 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761f8c-4c5d-4f08-a12d-3941eef1467a None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.805194 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761f8c-4c5d-4f08-a12d-3941eef1467a None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.805467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761f8c-4c5d-4f08-a12d-3941eef1467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.825385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-20761f8c-4c5d-4f08-a12d-3941eef1467a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:27.826598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-20761f8c-4c5d-4f08-a12d-3941eef1467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:27.835437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1306/2639] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:27.839729 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20761f8c-4c5d-4f08-a12d-3941eef1467a None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.843832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:27.849904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20761f8c-4c5d-4f08-a12d-3941eef1467a None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.854509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da7739-8d6b-482a-b963-2d4094262c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.856530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da7739-8d6b-482a-b963-2d4094262c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.856530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da7739-8d6b-482a-b963-2d4094262c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.856530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da7739-8d6b-482a-b963-2d4094262c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.856530 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da7739-8d6b-482a-b963-2d4094262c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:33:27.856932 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da7739-8d6b-482a-b963-2d4094262c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.858152 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da7739-8d6b-482a-b963-2d4094262c32 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.870460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1307/2640] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:33:27.874984 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da7739-8d6b-482a-b963-2d4094262c32 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.882296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1334/2641] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:27 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:33:27.885762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da7739-8d6b-482a-b963-2d4094262c32 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.890973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76505368-4d53-4106-8b03-b5f998027496 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.890973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-76505368-4d53-4106-8b03-b5f998027496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:27.893955 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347f4c9-0735-4bd0-b366-37612420cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.894724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347f4c9-0735-4bd0-b366-37612420cb1c admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.895001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347f4c9-0735-4bd0-b366-37612420cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.895272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347f4c9-0735-4bd0-b366-37612420cb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.895930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347f4c9-0735-4bd0-b366-37612420cb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.897826 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347f4c9-0735-4bd0-b366-37612420cb1c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.901290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76505368-4d53-4106-8b03-b5f998027496 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.906395 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cab4cd-36a9-4bcd-9012-c49c51c0c651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.907001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cab4cd-36a9-4bcd-9012-c49c51c0c651 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.907283 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cab4cd-36a9-4bcd-9012-c49c51c0c651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.907622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cab4cd-36a9-4bcd-9012-c49c51c0c651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.908373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cab4cd-36a9-4bcd-9012-c49c51c0c651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.910087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cab4cd-36a9-4bcd-9012-c49c51c0c651 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.920777 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1335/2642] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:33:27.925006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cab4cd-36a9-4bcd-9012-c49c51c0c651 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:27.934523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cab4cd-36a9-4bcd-9012-c49c51c0c651 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:27.939062 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7827f-a35e-47d1-a442-f3cb3e547708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:27.940194 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7827f-a35e-47d1-a442-f3cb3e547708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:27.940647 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7827f-a35e-47d1-a442-f3cb3e547708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:27.940958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7827f-a35e-47d1-a442-f3cb3e547708 admin admin] PATH_INFO: `/v3/projects/45d0b9af60ad44368d5de19f694c9db1/users/575fff55d9ce44d3b41213b7d5de28e2/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:27.956000 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7827f-a35e-47d1-a442-f3cb3e547708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d0b9af60ad44368d5de19f694c9db1, user_id=575fff55d9ce44d3b41213b7d5de28e2, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:27.958779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7827f-a35e-47d1-a442-f3cb3e547708 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:27.996621 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1308/2643] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:27 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:33:28.000761 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347f4c9-0735-4bd0-b366-37612420cb1c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:28.062836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347f4c9-0735-4bd0-b366-37612420cb1c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:28.065476 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1336/2644] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:27 2022] PUT /identity/v3/projects/45d0b9af60ad44368d5de19f694c9db1/users/575fff55d9ce44d3b41213b7d5de28e2/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:28.069366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7827f-a35e-47d1-a442-f3cb3e547708 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:28.124218 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49651c86-3be1-4ed2-b7e9-964ea3a36e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:28.124991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49651c86-3be1-4ed2-b7e9-964ea3a36e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.125372 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49651c86-3be1-4ed2-b7e9-964ea3a36e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.125746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49651c86-3be1-4ed2-b7e9-964ea3a36e1c admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.126612 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49651c86-3be1-4ed2-b7e9-964ea3a36e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:28.129447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49651c86-3be1-4ed2-b7e9-964ea3a36e1c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:28.134831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7827f-a35e-47d1-a442-f3cb3e547708 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:28.140041 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6858ddc-ee9e-4872-9677-71632bbd0a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:28.140649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6858ddc-ee9e-4872-9677-71632bbd0a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.140980 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6858ddc-ee9e-4872-9677-71632bbd0a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.141257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6858ddc-ee9e-4872-9677-71632bbd0a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.141945 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6858ddc-ee9e-4872-9677-71632bbd0a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:28.144438 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6858ddc-ee9e-4872-9677-71632bbd0a25 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:28.154926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1337/2645] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:33:28.159070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6858ddc-ee9e-4872-9677-71632bbd0a25 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:28.169686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6858ddc-ee9e-4872-9677-71632bbd0a25 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:28.175325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e0755-85d1-4a5f-a933-ed92db755642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:28.175926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0755-85d1-4a5f-a933-ed92db755642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.176198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0755-85d1-4a5f-a933-ed92db755642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.176470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0755-85d1-4a5f-a933-ed92db755642 admin admin] PATH_INFO: `/v3/projects/45d0b9af60ad44368d5de19f694c9db1/users/575fff55d9ce44d3b41213b7d5de28e2/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.178517 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e0755-85d1-4a5f-a933-ed92db755642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d0b9af60ad44368d5de19f694c9db1, user_id=575fff55d9ce44d3b41213b7d5de28e2, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:28.181091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e0755-85d1-4a5f-a933-ed92db755642 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:28.192302 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1338/2646] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:28 2022] PUT /identity/v3/projects/45d0b9af60ad44368d5de19f694c9db1/users/575fff55d9ce44d3b41213b7d5de28e2/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:28.243425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1309/2647] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:27 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:33:28.247896 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e0755-85d1-4a5f-a933-ed92db755642 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:28.260847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa71c3-dd5b-4cee-b0f2-d61282f84557 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.261135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa71c3-dd5b-4cee-b0f2-d61282f84557 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.261413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa71c3-dd5b-4cee-b0f2-d61282f84557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.290889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-13aa71c3-dd5b-4cee-b0f2-d61282f84557 None None] MFA Rules not processed for user `575fff55d9ce44d3b41213b7d5de28e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:28.292118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-13aa71c3-dd5b-4cee-b0f2-d61282f84557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:28.317107 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e0755-85d1-4a5f-a933-ed92db755642 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:28.322735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8262-660b-4985-88f6-5e7fe78c7c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:28.323340 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8262-660b-4985-88f6-5e7fe78c7c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.323618 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8262-660b-4985-88f6-5e7fe78c7c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.323883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8262-660b-4985-88f6-5e7fe78c7c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.324565 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b8262-660b-4985-88f6-5e7fe78c7c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:28.326137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b8262-660b-4985-88f6-5e7fe78c7c9c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:28.336382 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1339/2648] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:28.340390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8262-660b-4985-88f6-5e7fe78c7c9c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:28.346560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:28.346840 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:28.350253 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8262-660b-4985-88f6-5e7fe78c7c9c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:28.354846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4465dc2-c4a7-4f23-b720-900feb935b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:28.355430 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4465dc2-c4a7-4f23-b720-900feb935b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.361215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4465dc2-c4a7-4f23-b720-900feb935b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.361215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4465dc2-c4a7-4f23-b720-900feb935b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.361215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4465dc2-c4a7-4f23-b720-900feb935b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:28.361215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4465dc2-c4a7-4f23-b720-900feb935b76 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:28.367362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1310/2649] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:28.368656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1340/2650] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:28.375236 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa71c3-dd5b-4cee-b0f2-d61282f84557 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:28.380317 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4465dc2-c4a7-4f23-b720-900feb935b76 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:28.382050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e4465dc2-c4a7-4f23-b720-900feb935b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:28.386222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa71c3-dd5b-4cee-b0f2-d61282f84557 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:28.391175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e3e81-4786-4502-82f6-8a24f6856ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:28.392123 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e3e81-4786-4502-82f6-8a24f6856ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.392434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e3e81-4786-4502-82f6-8a24f6856ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.392683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e3e81-4786-4502-82f6-8a24f6856ac5 admin admin] PATH_INFO: `/v3/projects/f6e97e779e134097aa437a43d02e87a8/users/2fca4761e0d143d3824b64794c2b09b9/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.409952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e3e81-4786-4502-82f6-8a24f6856ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e97e779e134097aa437a43d02e87a8, user_id=2fca4761e0d143d3824b64794c2b09b9, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:28.412757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e3e81-4786-4502-82f6-8a24f6856ac5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:28.454847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1311/2651] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:28 2022] PUT /identity/v3/projects/f6e97e779e134097aa437a43d02e87a8/users/2fca4761e0d143d3824b64794c2b09b9/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:28.465362 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4d3f0-d007-4a40-ba3e-455311e300f8 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.465648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4d3f0-d007-4a40-ba3e-455311e300f8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.465923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4d3f0-d007-4a40-ba3e-455311e300f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.466044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4465dc2-c4a7-4f23-b720-900feb935b76 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:28.493976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-68e4d3f0-d007-4a40-ba3e-455311e300f8 None None] MFA Rules not processed for user `2fca4761e0d143d3824b64794c2b09b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:28.495224 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-68e4d3f0-d007-4a40-ba3e-455311e300f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:28.516507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bccd4c-efc4-4c85-8235-a8507256df20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:28.517116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bccd4c-efc4-4c85-8235-a8507256df20 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.517389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bccd4c-efc4-4c85-8235-a8507256df20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.517657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bccd4c-efc4-4c85-8235-a8507256df20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.561023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1312/2652] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:28.572801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4d3f0-d007-4a40-ba3e-455311e300f8 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:28.574587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-68e4d3f0-d007-4a40-ba3e-455311e300f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:28.581367 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bccd4c-efc4-4c85-8235-a8507256df20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:28.582834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bccd4c-efc4-4c85-8235-a8507256df20 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:28.587015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4d3f0-d007-4a40-ba3e-455311e300f8 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:28.590705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9972-c09a-4705-a078-26b9e3c853ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:28.591313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9972-c09a-4705-a078-26b9e3c853ac service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.591588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9972-c09a-4705-a078-26b9e3c853ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.591857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9972-c09a-4705-a078-26b9e3c853ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.592602 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1341/2653] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:33:28.602532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9972-c09a-4705-a078-26b9e3c853ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:28.602980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9972-c09a-4705-a078-26b9e3c853ac service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:28.613061 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1313/2654] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:33:28.638820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bccd4c-efc4-4c85-8235-a8507256df20 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:28.681987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:28.701198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bccd4c-efc4-4c85-8235-a8507256df20 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:28.705803 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:28.706451 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.706725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.706993 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] PATH_INFO: `/v3/users/2fca4761e0d143d3824b64794c2b09b9` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.708170 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fca4761e0d143d3824b64794c2b09b9)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:28.710061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:28.736014 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9972-c09a-4705-a078-26b9e3c853ac service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:28.745827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9972-c09a-4705-a078-26b9e3c853ac service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:28.749616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21f5b9-772c-4bb7-a5ee-bfc7e77c6b57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:28.751639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f5b9-772c-4bb7-a5ee-bfc7e77c6b57 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.751639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f5b9-772c-4bb7-a5ee-bfc7e77c6b57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.751639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f5b9-772c-4bb7-a5ee-bfc7e77c6b57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:28.752836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ac21f5b9-772c-4bb7-a5ee-bfc7e77c6b57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:28.812939 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21f5b9-772c-4bb7-a5ee-bfc7e77c6b57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:28.814450 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21f5b9-772c-4bb7-a5ee-bfc7e77c6b57 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:28.828807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1314/2655] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:33:28.865272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fca4761e0d143d3824b64794c2b09b9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:28.865272 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fca4761e0d143d3824b64794c2b09b9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:28.873084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fca4761e0d143d3824b64794c2b09b9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:28.884897 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fca4761e0d143d3824b64794c2b09b9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:28.966547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fca4761e0d143d3824b64794c2b09b9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:28.975092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1342/2656] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:28 2022] DELETE /identity/v3/users/2fca4761e0d143d3824b64794c2b09b9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:28.979606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a9602-499e-4ca0-ba73-1f48d1813fa5 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:28.979894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a9602-499e-4ca0-ba73-1f48d1813fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:28.980175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a9602-499e-4ca0-ba73-1f48d1813fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:29.001806 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e93a9602-499e-4ca0-ba73-1f48d1813fa5 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:29.003289 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e93a9602-499e-4ca0-ba73-1f48d1813fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:29.041386 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:29.068044 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1315/2657] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:29.078245 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:29.085034 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:29.140732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202db34-0130-41fc-bf8b-b2f66f1b353f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:29.145126 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee805edb-350d-4680-a3f5-0aa054f7bd5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:29.145735 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee805edb-350d-4680-a3f5-0aa054f7bd5b service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:29.146014 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee805edb-350d-4680-a3f5-0aa054f7bd5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:29.146285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee805edb-350d-4680-a3f5-0aa054f7bd5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:29.156381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee805edb-350d-4680-a3f5-0aa054f7bd5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:29.157814 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee805edb-350d-4680-a3f5-0aa054f7bd5b service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:29.178259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1343/2658] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:29.333492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a9602-499e-4ca0-ba73-1f48d1813fa5 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:29.334976 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e93a9602-499e-4ca0-ba73-1f48d1813fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:29.346841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a9602-499e-4ca0-ba73-1f48d1813fa5 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:29.351240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:29.351861 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:29.352136 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:29.352403 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] PATH_INFO: `/v3/users/276a3676574d45eeb8abd3a6b520a7a5` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:29.353535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] RBAC: Authorizing `identity:delete_user(user_id=276a3676574d45eeb8abd3a6b520a7a5)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:29.355480 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:29.564426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276a3676574d45eeb8abd3a6b520a7a5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:29.565778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276a3676574d45eeb8abd3a6b520a7a5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:29.572765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276a3676574d45eeb8abd3a6b520a7a5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:29.573399 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276a3676574d45eeb8abd3a6b520a7a5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:29.635198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee805edb-350d-4680-a3f5-0aa054f7bd5b service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:29.636640 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ee805edb-350d-4680-a3f5-0aa054f7bd5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:29.652370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-4f1a670d-17af-4f15-8be7-10d54480891f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276a3676574d45eeb8abd3a6b520a7a5'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:29.653686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee805edb-350d-4680-a3f5-0aa054f7bd5b service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:29.659260 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:29.660009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:29.660162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:29.660488 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] PATH_INFO: `/v3/projects/f6e97e779e134097aa437a43d02e87a8` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:29.662262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e97e779e134097aa437a43d02e87a8)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:29.664203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:29.679461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1316/2659] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:29 2022] DELETE /identity/v3/users/276a3676574d45eeb8abd3a6b520a7a5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:29.684292 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b96799-64be-4641-9ece-fc157c5ef020 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:29.684501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b96799-64be-4641-9ece-fc157c5ef020 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:29.684747 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b96799-64be-4641-9ece-fc157c5ef020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:29.704535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-25b96799-64be-4641-9ece-fc157c5ef020 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:29.705807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-25b96799-64be-4641-9ece-fc157c5ef020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:29.765309 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1317/2660] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:29.776055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b96799-64be-4641-9ece-fc157c5ef020 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:29.777499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-25b96799-64be-4641-9ece-fc157c5ef020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:29.780169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e97e779e134097aa437a43d02e87a8', 'request_id': 'req-3c26d419-4781-44df-afbf-2bf417ca10d7'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:29.786734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e97e779e134097aa437a43d02e87a8', 'request_id': 'req-3c26d419-4781-44df-afbf-2bf417ca10d7'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:29.789691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:29.836404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b96799-64be-4641-9ece-fc157c5ef020 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:29.840908 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:29.885275 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61f49-d5c9-427d-908c-ea7ff9e903b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:29.885675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61f49-d5c9-427d-908c-ea7ff9e903b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:29.885952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61f49-d5c9-427d-908c-ea7ff9e903b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:29.886225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61f49-d5c9-427d-908c-ea7ff9e903b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:29.903832 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e97e779e134097aa437a43d02e87a8', 'request_id': 'req-3c26d419-4781-44df-afbf-2bf417ca10d7'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:29.916394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] The token cache is being invalidate because project f6e97e779e134097aa437a43d02e87a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:29.916685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:29.917333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3c26d419-4781-44df-afbf-2bf417ca10d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:29.918985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1344/2661] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:29 2022] DELETE /identity/v3/projects/f6e97e779e134097aa437a43d02e87a8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:29.924723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0175-bc19-4fd5-9b0a-b55cd0bdf5fd None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:29.925116 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0175-bc19-4fd5-9b0a-b55cd0bdf5fd None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:29.925399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0175-bc19-4fd5-9b0a-b55cd0bdf5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:29.945545 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-409b0175-bc19-4fd5-9b0a-b55cd0bdf5fd None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:29.946912 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-409b0175-bc19-4fd5-9b0a-b55cd0bdf5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:29.950659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b61f49-d5c9-427d-908c-ea7ff9e903b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:29.952333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b61f49-d5c9-427d-908c-ea7ff9e903b1 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:29.955402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1345/2662] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:29.962426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1318/2663] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:33:29.965129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c392ac-b67e-47fc-af86-9847d636fe51 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:29.965129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c392ac-b67e-47fc-af86-9847d636fe51 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:29.965129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c392ac-b67e-47fc-af86-9847d636fe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:29.985159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-e1c392ac-b67e-47fc-af86-9847d636fe51 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:29.986404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e1c392ac-b67e-47fc-af86-9847d636fe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:29.995344 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1346/2664] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:29.999460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61f49-d5c9-427d-908c-ea7ff9e903b1 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:30.001274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-a5b61f49-d5c9-427d-908c-ea7ff9e903b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:30.021210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61f49-d5c9-427d-908c-ea7ff9e903b1 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:30.026065 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecd2fa-172e-4343-9890-a3dbb697cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:30.026736 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecd2fa-172e-4343-9890-a3dbb697cf2f admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:30.027016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecd2fa-172e-4343-9890-a3dbb697cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:30.027291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecd2fa-172e-4343-9890-a3dbb697cf2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:30.028249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecd2fa-172e-4343-9890-a3dbb697cf2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:33:30.028551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecd2fa-172e-4343-9890-a3dbb697cf2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:30.030134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecd2fa-172e-4343-9890-a3dbb697cf2f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:30.045718 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1319/2665] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:33:30.046913 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c392ac-b67e-47fc-af86-9847d636fe51 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:30.056732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c392ac-b67e-47fc-af86-9847d636fe51 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:30.061848 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ba68f-f4b4-425c-a458-51555c26a590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:30.062656 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba68f-f4b4-425c-a458-51555c26a590 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:30.063057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba68f-f4b4-425c-a458-51555c26a590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:30.063337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba68f-f4b4-425c-a458-51555c26a590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:30.064042 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ba68f-f4b4-425c-a458-51555c26a590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:30.066807 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ba68f-f4b4-425c-a458-51555c26a590 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:30.177179 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1347/2666] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:30 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:30.181597 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecd2fa-172e-4343-9890-a3dbb697cf2f admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:30.192175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecd2fa-172e-4343-9890-a3dbb697cf2f admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:30.259601 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18be9a5-aea9-4810-98f2-a6fe699d1c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:30.260217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be9a5-aea9-4810-98f2-a6fe699d1c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:30.260493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be9a5-aea9-4810-98f2-a6fe699d1c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:30.260780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be9a5-aea9-4810-98f2-a6fe699d1c0c admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:30.261419 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18be9a5-aea9-4810-98f2-a6fe699d1c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:30.263406 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18be9a5-aea9-4810-98f2-a6fe699d1c0c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:30.378966 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1320/2667] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:30 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:30.383124 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ba68f-f4b4-425c-a458-51555c26a590 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:30.393360 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ba68f-f4b4-425c-a458-51555c26a590 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:30.397841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30813b-5443-46d0-b875-e5e9a3d91c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:30.398754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30813b-5443-46d0-b875-e5e9a3d91c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:30.399029 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30813b-5443-46d0-b875-e5e9a3d91c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:30.399297 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30813b-5443-46d0-b875-e5e9a3d91c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:30.400086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30813b-5443-46d0-b875-e5e9a3d91c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:30.401614 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30813b-5443-46d0-b875-e5e9a3d91c35 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:30.413537 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1348/2668] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:30.419399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30813b-5443-46d0-b875-e5e9a3d91c35 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:30.422913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18be9a5-aea9-4810-98f2-a6fe699d1c0c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:30.426140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d18be9a5-aea9-4810-98f2-a6fe699d1c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:30.431486 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30813b-5443-46d0-b875-e5e9a3d91c35 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:30.438177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4108f1-12ef-45bc-82b3-60fcb1770bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:30.439255 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4108f1-12ef-45bc-82b3-60fcb1770bea admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:30.439378 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18be9a5-aea9-4810-98f2-a6fe699d1c0c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:30.439794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4108f1-12ef-45bc-82b3-60fcb1770bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:30.440411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4108f1-12ef-45bc-82b3-60fcb1770bea admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:30.441373 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4108f1-12ef-45bc-82b3-60fcb1770bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:30.443023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4108f1-12ef-45bc-82b3-60fcb1770bea admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:30.444557 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:30.445238 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:30.445522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:30.445799 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] PATH_INFO: `/v3/projects/c2a819899f574b22a29202ec2e83d348` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:30.447050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a819899f574b22a29202ec2e83d348)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:30.448961 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:30.454057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1349/2669] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:33:30.459605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4108f1-12ef-45bc-82b3-60fcb1770bea admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:30.471725 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4108f1-12ef-45bc-82b3-60fcb1770bea admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:30.476740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c3b97-963d-4775-bb3a-4e40cfda1db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:30.477471 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c3b97-963d-4775-bb3a-4e40cfda1db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:30.477819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c3b97-963d-4775-bb3a-4e40cfda1db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:30.478094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c3b97-963d-4775-bb3a-4e40cfda1db6 admin admin] PATH_INFO: `/v3/projects/2f6bda6801cf4d18abdeab209ec0037d/users/f56d0ab5cf9d4c85841b57f4fe91107b/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:30.493225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c3b97-963d-4775-bb3a-4e40cfda1db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6bda6801cf4d18abdeab209ec0037d, user_id=f56d0ab5cf9d4c85841b57f4fe91107b, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:30.496005 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c3b97-963d-4775-bb3a-4e40cfda1db6 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:30.556451 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:30.561365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1350/2670] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:30 2022] PUT /identity/v3/projects/2f6bda6801cf4d18abdeab209ec0037d/users/f56d0ab5cf9d4c85841b57f4fe91107b/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:30.570286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a819899f574b22a29202ec2e83d348', 'request_id': 'req-08c0e1a6-8789-49be-9d4b-82423242be67'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:30.572929 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68e2d-bf09-41bb-acdf-c57f3e35ee75 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:30.573399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68e2d-bf09-41bb-acdf-c57f3e35ee75 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:30.573830 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68e2d-bf09-41bb-acdf-c57f3e35ee75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:30.577497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a819899f574b22a29202ec2e83d348', 'request_id': 'req-08c0e1a6-8789-49be-9d4b-82423242be67'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:30.601942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-81d68e2d-bf09-41bb-acdf-c57f3e35ee75 None None] MFA Rules not processed for user `f56d0ab5cf9d4c85841b57f4fe91107b`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:30.603164 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-81d68e2d-bf09-41bb-acdf-c57f3e35ee75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:30.634802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a819899f574b22a29202ec2e83d348', 'request_id': 'req-08c0e1a6-8789-49be-9d4b-82423242be67'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:30.648018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] The token cache is being invalidate because project c2a819899f574b22a29202ec2e83d348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:30.648331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:30.648982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:30.650972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1321/2671] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:30 2022] DELETE /identity/v3/projects/c2a819899f574b22a29202ec2e83d348 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:30.654912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:30.656225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:30.669307 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1351/2672] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:30.680427 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68e2d-bf09-41bb-acdf-c57f3e35ee75 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:30.681769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-81d68e2d-bf09-41bb-acdf-c57f3e35ee75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:30.730488 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0e1a6-8789-49be-9d4b-82423242be67 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:30.735705 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:30.736397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:30.736707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:30.736986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] PATH_INFO: `/v3/users/575fff55d9ce44d3b41213b7d5de28e2` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:30.738429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575fff55d9ce44d3b41213b7d5de28e2)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:30.740352 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:30.743268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68e2d-bf09-41bb-acdf-c57f3e35ee75 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:30.746938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee157027-58a5-41da-8070-b12b9a5a0b02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:30.747548 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee157027-58a5-41da-8070-b12b9a5a0b02 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:30.747829 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee157027-58a5-41da-8070-b12b9a5a0b02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:30.748101 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee157027-58a5-41da-8070-b12b9a5a0b02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:30.755147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:30.759181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee157027-58a5-41da-8070-b12b9a5a0b02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:30.763841 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee157027-58a5-41da-8070-b12b9a5a0b02 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:30.775407 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1352/2673] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:30.946371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575fff55d9ce44d3b41213b7d5de28e2'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:30.947009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575fff55d9ce44d3b41213b7d5de28e2'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:30.954452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575fff55d9ce44d3b41213b7d5de28e2'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:30.955109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575fff55d9ce44d3b41213b7d5de28e2'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:31.041138 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c6e6dcb4-4711-4b6f-aa74-0149d8b963a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575fff55d9ce44d3b41213b7d5de28e2'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:31.062566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1322/2674] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:30 2022] DELETE /identity/v3/users/575fff55d9ce44d3b41213b7d5de28e2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:31.501955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee157027-58a5-41da-8070-b12b9a5a0b02 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:31.516213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee157027-58a5-41da-8070-b12b9a5a0b02 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:31.589139 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:31.589781 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:31.590056 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:31.590352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] PATH_INFO: `/v3/projects/45d0b9af60ad44368d5de19f694c9db1` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:31.591701 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d0b9af60ad44368d5de19f694c9db1)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:31.594088 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:31.727600 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d0b9af60ad44368d5de19f694c9db1', 'request_id': 'req-2b83051a-e3c4-471f-95e0-52e5fb319d0a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:31.733718 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d0b9af60ad44368d5de19f694c9db1', 'request_id': 'req-2b83051a-e3c4-471f-95e0-52e5fb319d0a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:31.852394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d0b9af60ad44368d5de19f694c9db1', 'request_id': 'req-2b83051a-e3c4-471f-95e0-52e5fb319d0a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:31.864186 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] The token cache is being invalidate because project 45d0b9af60ad44368d5de19f694c9db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:31.864470 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:31.865087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-2b83051a-e3c4-471f-95e0-52e5fb319d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:31.866640 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1353/2675] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:31 2022] DELETE /identity/v3/projects/45d0b9af60ad44368d5de19f694c9db1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:31.872010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c799-5283-4b71-bfcc-7bec35091b42 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:31.872560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c799-5283-4b71-bfcc-7bec35091b42 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:31.872661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c799-5283-4b71-bfcc-7bec35091b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:31.894398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-0271c799-5283-4b71-bfcc-7bec35091b42 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:31.895629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-0271c799-5283-4b71-bfcc-7bec35091b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:31.929313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:31.956259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1323/2676] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:31.963861 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85cba9-6889-4f6d-83d2-fb1f6d562f1a None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:31.964142 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85cba9-6889-4f6d-83d2-fb1f6d562f1a None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:31.964415 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85cba9-6889-4f6d-83d2-fb1f6d562f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:31.984018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9f85cba9-6889-4f6d-83d2-fb1f6d562f1a None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:31.985128 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9f85cba9-6889-4f6d-83d2-fb1f6d562f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:31.994023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1354/2677] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:31.998380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c799-5283-4b71-bfcc-7bec35091b42 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:32.009502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c799-5283-4b71-bfcc-7bec35091b42 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:32.014296 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417269f1-450b-4128-a1ca-286a99500e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:32.015034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417269f1-450b-4128-a1ca-286a99500e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:32.015311 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417269f1-450b-4128-a1ca-286a99500e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:32.015584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417269f1-450b-4128-a1ca-286a99500e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:32.016297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417269f1-450b-4128-a1ca-286a99500e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:33:32.016657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417269f1-450b-4128-a1ca-286a99500e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:32.018963 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417269f1-450b-4128-a1ca-286a99500e31 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:32.031187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1324/2678] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:33:32.035831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85cba9-6889-4f6d-83d2-fb1f6d562f1a None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:32.045041 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85cba9-6889-4f6d-83d2-fb1f6d562f1a None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:32.050228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe9f19-bd88-4414-9f3f-281e98193936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:32.050948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe9f19-bd88-4414-9f3f-281e98193936 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:32.051223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe9f19-bd88-4414-9f3f-281e98193936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:32.051495 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe9f19-bd88-4414-9f3f-281e98193936 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:32.052154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe9f19-bd88-4414-9f3f-281e98193936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:32.054052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe9f19-bd88-4414-9f3f-281e98193936 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:32.139797 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1355/2679] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:32 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:32.144508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417269f1-450b-4128-a1ca-286a99500e31 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:32.155282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417269f1-450b-4128-a1ca-286a99500e31 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:32.214289 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0c30b-5a0a-42a0-a958-e959d278f572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:32.215086 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0c30b-5a0a-42a0-a958-e959d278f572 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:32.215370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0c30b-5a0a-42a0-a958-e959d278f572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:32.215648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0c30b-5a0a-42a0-a958-e959d278f572 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:32.216309 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0c30b-5a0a-42a0-a958-e959d278f572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:32.218220 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0c30b-5a0a-42a0-a958-e959d278f572 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:32.327708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1325/2680] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:32 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:32.331821 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe9f19-bd88-4414-9f3f-281e98193936 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:32.342659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe9f19-bd88-4414-9f3f-281e98193936 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:32.347913 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6bba3-a676-44fc-be6f-812850a3cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:32.348512 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6bba3-a676-44fc-be6f-812850a3cefd admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:32.348783 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6bba3-a676-44fc-be6f-812850a3cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:32.349052 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6bba3-a676-44fc-be6f-812850a3cefd admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:32.349732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6bba3-a676-44fc-be6f-812850a3cefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:32.351410 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6bba3-a676-44fc-be6f-812850a3cefd admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:32.361399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1356/2681] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:32.366493 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0c30b-5a0a-42a0-a958-e959d278f572 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:32.376617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0c30b-5a0a-42a0-a958-e959d278f572 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:32.381423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f6a9-0d01-4de1-8a61-6ddb2c888dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:32.382075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f6a9-0d01-4de1-8a61-6ddb2c888dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:32.382366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f6a9-0d01-4de1-8a61-6ddb2c888dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:32.382762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f6a9-0d01-4de1-8a61-6ddb2c888dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:32.383460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8f6a9-0d01-4de1-8a61-6ddb2c888dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:32.385049 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8f6a9-0d01-4de1-8a61-6ddb2c888dd1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:32.396286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1326/2682] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:32.400916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6bba3-a676-44fc-be6f-812850a3cefd admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:32.411868 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6bba3-a676-44fc-be6f-812850a3cefd admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:32.416440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea54f2-8445-4a3b-9292-299c99a30e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:32.417085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea54f2-8445-4a3b-9292-299c99a30e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:32.417362 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea54f2-8445-4a3b-9292-299c99a30e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:32.417634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea54f2-8445-4a3b-9292-299c99a30e78 admin admin] PATH_INFO: `/v3/projects/93d42510e9064a1c922dc920efc11f0d/users/5dd66343c92a47c6b7cb1eeb1d161e79/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:32.432778 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea54f2-8445-4a3b-9292-299c99a30e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d42510e9064a1c922dc920efc11f0d, user_id=5dd66343c92a47c6b7cb1eeb1d161e79, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:32.435442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea54f2-8445-4a3b-9292-299c99a30e78 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:32.530612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1357/2683] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:32 2022] PUT /identity/v3/projects/93d42510e9064a1c922dc920efc11f0d/users/5dd66343c92a47c6b7cb1eeb1d161e79/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:33:32.543355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c8fbb-05d6-46ce-b9ab-09dd5ffa5727 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:32.543647 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c8fbb-05d6-46ce-b9ab-09dd5ffa5727 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:32.543930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c8fbb-05d6-46ce-b9ab-09dd5ffa5727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:32.552265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08b808-e074-402e-b573-f9cafa1a9e82 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:32.552552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08b808-e074-402e-b573-f9cafa1a9e82 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:32.552826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08b808-e074-402e-b573-f9cafa1a9e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:32.572642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-9f08b808-e074-402e-b573-f9cafa1a9e82 None None] MFA Rules not processed for user `f56d0ab5cf9d4c85841b57f4fe91107b`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:32.573508 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-729c8fbb-05d6-46ce-b9ab-09dd5ffa5727 None None] MFA Rules not processed for user `5dd66343c92a47c6b7cb1eeb1d161e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:32.573846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9f08b808-e074-402e-b573-f9cafa1a9e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:32.574732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-729c8fbb-05d6-46ce-b9ab-09dd5ffa5727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:32.590195 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:32.631883 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1358/2684] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:32.645051 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1327/2685] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:32.661076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08b808-e074-402e-b573-f9cafa1a9e82 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:32.662614 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-9f08b808-e074-402e-b573-f9cafa1a9e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:32.724786 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08b808-e074-402e-b573-f9cafa1a9e82 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:32.729081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f817e-05f8-40d0-9f7e-3b2dc793e297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:32.729699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f817e-05f8-40d0-9f7e-3b2dc793e297 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:32.729978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f817e-05f8-40d0-9f7e-3b2dc793e297 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:32.730257 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f817e-05f8-40d0-9f7e-3b2dc793e297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:32.740406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f817e-05f8-40d0-9f7e-3b2dc793e297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:32.741854 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f817e-05f8-40d0-9f7e-3b2dc793e297 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:32.751450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1359/2686] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:32.775208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c8fbb-05d6-46ce-b9ab-09dd5ffa5727 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:32.812643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:32.842888 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c8fbb-05d6-46ce-b9ab-09dd5ffa5727 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:32.848112 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:32.848760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:32.849035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:32.849305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] PATH_INFO: `/v3/users/5dd66343c92a47c6b7cb1eeb1d161e79` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:32.850505 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd66343c92a47c6b7cb1eeb1d161e79)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:32.852460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:33.057430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd66343c92a47c6b7cb1eeb1d161e79'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:33.058142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd66343c92a47c6b7cb1eeb1d161e79'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:33.066514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd66343c92a47c6b7cb1eeb1d161e79'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:33.067203 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd66343c92a47c6b7cb1eeb1d161e79'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:33.161687 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd66343c92a47c6b7cb1eeb1d161e79'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:33.183947 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1328/2687] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:32 2022] DELETE /identity/v3/users/5dd66343c92a47c6b7cb1eeb1d161e79 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:33.188006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b430-3e2d-4efa-bc37-1abf4bdf24ba None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:33.188359 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b430-3e2d-4efa-bc37-1abf4bdf24ba None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:33.188990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b430-3e2d-4efa-bc37-1abf4bdf24ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:33.208723 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ba22b430-3e2d-4efa-bc37-1abf4bdf24ba None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:33.210902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ba22b430-3e2d-4efa-bc37-1abf4bdf24ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:33.272751 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1360/2688] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:33.287696 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:33.289126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:33.349762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a631ad-5d5f-4c97-a789-573141d5b825 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:33.353341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81511ac3-3763-4ce0-8a10-cdd3f20d3454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:33.353950 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81511ac3-3763-4ce0-8a10-cdd3f20d3454 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:33.354225 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81511ac3-3763-4ce0-8a10-cdd3f20d3454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:33.354520 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81511ac3-3763-4ce0-8a10-cdd3f20d3454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:33.363903 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81511ac3-3763-4ce0-8a10-cdd3f20d3454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:33.365402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81511ac3-3763-4ce0-8a10-cdd3f20d3454 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:33.375454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1329/2689] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:33.837177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b430-3e2d-4efa-bc37-1abf4bdf24ba None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:33.838647 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ba22b430-3e2d-4efa-bc37-1abf4bdf24ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:33.851147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b430-3e2d-4efa-bc37-1abf4bdf24ba None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:33.856017 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:33.856733 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:33.857043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:33.857313 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] PATH_INFO: `/v3/projects/93d42510e9064a1c922dc920efc11f0d` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:33.858544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d42510e9064a1c922dc920efc11f0d)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:33.860429 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:33.966616 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d42510e9064a1c922dc920efc11f0d', 'request_id': 'req-90af86a2-83e0-47c5-a22b-afa01207666a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:33.973611 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d42510e9064a1c922dc920efc11f0d', 'request_id': 'req-90af86a2-83e0-47c5-a22b-afa01207666a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:34.040646 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d42510e9064a1c922dc920efc11f0d', 'request_id': 'req-90af86a2-83e0-47c5-a22b-afa01207666a'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:34.044873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:34.052716 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] The token cache is being invalidate because project 93d42510e9064a1c922dc920efc11f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:34.053003 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:34.053635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-90af86a2-83e0-47c5-a22b-afa01207666a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:34.055201 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1361/2690] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:33 2022] DELETE /identity/v3/projects/93d42510e9064a1c922dc920efc11f0d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:34.060281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b0bdc-9a31-4187-a680-16879ef76a9d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:34.060769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b0bdc-9a31-4187-a680-16879ef76a9d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:34.060905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b0bdc-9a31-4187-a680-16879ef76a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:34.080798 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-671b0bdc-9a31-4187-a680-16879ef76a9d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:34.081875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-671b0bdc-9a31-4187-a680-16879ef76a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:34.130663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:34.143293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1330/2691] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:34.151275 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df807798-d694-491d-8512-e9390cb3aa72 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:34.151586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df807798-d694-491d-8512-e9390cb3aa72 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:34.151866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df807798-d694-491d-8512-e9390cb3aa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:34.177695 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-df807798-d694-491d-8512-e9390cb3aa72 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:34.178959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-df807798-d694-491d-8512-e9390cb3aa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:34.189354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1362/2692] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:34.193658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b0bdc-9a31-4187-a680-16879ef76a9d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:34.203397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b0bdc-9a31-4187-a680-16879ef76a9d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:34.209351 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfa9f-7ab8-4a79-8b45-729ef54e0166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:34.209954 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfa9f-7ab8-4a79-8b45-729ef54e0166 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:34.210274 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfa9f-7ab8-4a79-8b45-729ef54e0166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:34.210643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfa9f-7ab8-4a79-8b45-729ef54e0166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:34.211212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbfa9f-7ab8-4a79-8b45-729ef54e0166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:33:34.211565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbfa9f-7ab8-4a79-8b45-729ef54e0166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:34.213113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbfa9f-7ab8-4a79-8b45-729ef54e0166 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:34.229177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1331/2693] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:33:34.235320 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df807798-d694-491d-8512-e9390cb3aa72 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:34.241123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df807798-d694-491d-8512-e9390cb3aa72 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:34.245874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9eb8d-01c3-4822-a66f-8e29646d3189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:34.246513 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9eb8d-01c3-4822-a66f-8e29646d3189 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:34.246798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9eb8d-01c3-4822-a66f-8e29646d3189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:34.247070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9eb8d-01c3-4822-a66f-8e29646d3189 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:34.247741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9eb8d-01c3-4822-a66f-8e29646d3189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:34.249643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9eb8d-01c3-4822-a66f-8e29646d3189 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:34.340658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1363/2694] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:34 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:34.345178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfa9f-7ab8-4a79-8b45-729ef54e0166 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:34.361076 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfa9f-7ab8-4a79-8b45-729ef54e0166 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:34.426956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce54f55-28bf-4ad1-8f50-0e909c665cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:34.427582 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce54f55-28bf-4ad1-8f50-0e909c665cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:34.427869 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce54f55-28bf-4ad1-8f50-0e909c665cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:34.428188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce54f55-28bf-4ad1-8f50-0e909c665cbe admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:34.428839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce54f55-28bf-4ad1-8f50-0e909c665cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:34.430807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce54f55-28bf-4ad1-8f50-0e909c665cbe admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:34.569499 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1332/2695] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:34 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:34.573864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9eb8d-01c3-4822-a66f-8e29646d3189 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:34.587099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9eb8d-01c3-4822-a66f-8e29646d3189 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:34.591927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e53965-76ae-4283-952f-5e772ee9182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:34.592538 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53965-76ae-4283-952f-5e772ee9182d admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:34.592812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53965-76ae-4283-952f-5e772ee9182d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:34.593103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53965-76ae-4283-952f-5e772ee9182d admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:34.593828 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e53965-76ae-4283-952f-5e772ee9182d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:34.595446 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e53965-76ae-4283-952f-5e772ee9182d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:34.607360 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1364/2696] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:34.616630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce54f55-28bf-4ad1-8f50-0e909c665cbe admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:34.627720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce54f55-28bf-4ad1-8f50-0e909c665cbe admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:34.632519 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a103c-d9ff-4d16-9da5-02cda4b83710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:34.633139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a103c-d9ff-4d16-9da5-02cda4b83710 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:34.633421 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a103c-d9ff-4d16-9da5-02cda4b83710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:34.633698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a103c-d9ff-4d16-9da5-02cda4b83710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:34.634426 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a103c-d9ff-4d16-9da5-02cda4b83710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:34.636075 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a103c-d9ff-4d16-9da5-02cda4b83710 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:34.648405 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1333/2697] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:34.653574 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e53965-76ae-4283-952f-5e772ee9182d admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:34.665617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e53965-76ae-4283-952f-5e772ee9182d admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:34.671065 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16e96d-90de-4c7d-8654-bbc6793dcf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:34.671715 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16e96d-90de-4c7d-8654-bbc6793dcf56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:34.671992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16e96d-90de-4c7d-8654-bbc6793dcf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:34.672261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16e96d-90de-4c7d-8654-bbc6793dcf56 admin admin] PATH_INFO: `/v3/projects/916131afb30a4fbfba317502a6125195/users/03f1ffb974d94c3ca14334dcf70f6533/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:34.690578 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16e96d-90de-4c7d-8654-bbc6793dcf56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916131afb30a4fbfba317502a6125195, user_id=03f1ffb974d94c3ca14334dcf70f6533, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:34.694727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16e96d-90de-4c7d-8654-bbc6793dcf56 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:34.762287 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1365/2698] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:34 2022] PUT /identity/v3/projects/916131afb30a4fbfba317502a6125195/users/03f1ffb974d94c3ca14334dcf70f6533/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:34.773560 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a38c8-c053-4966-be73-bffaaca2d0b8 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:34.773848 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a38c8-c053-4966-be73-bffaaca2d0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:34.774129 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a38c8-c053-4966-be73-bffaaca2d0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:34.807284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e82a38c8-c053-4966-be73-bffaaca2d0b8 None None] MFA Rules not processed for user `03f1ffb974d94c3ca14334dcf70f6533`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:34.808546 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e82a38c8-c053-4966-be73-bffaaca2d0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:34.902360 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1334/2699] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:34.950060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16e96d-90de-4c7d-8654-bbc6793dcf56 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:34.950060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4b16e96d-90de-4c7d-8654-bbc6793dcf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:34.988442 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16e96d-90de-4c7d-8654-bbc6793dcf56 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:34.992389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a86e4-6505-489d-af76-449fc23c970a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:34.993039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a86e4-6505-489d-af76-449fc23c970a service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:34.993352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a86e4-6505-489d-af76-449fc23c970a service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:34.993658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a86e4-6505-489d-af76-449fc23c970a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:35.004144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a86e4-6505-489d-af76-449fc23c970a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:35.005590 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a86e4-6505-489d-af76-449fc23c970a service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:35.019617 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1366/2700] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:44.896525 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:45.014150 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:DELETE=1,keystone:SELECT=55,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:58.123858 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a38c8-c053-4966-be73-bffaaca2d0b8 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:58.189374 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a38c8-c053-4966-be73-bffaaca2d0b8 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:58.193922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:58.194601 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:58.194877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:58.195153 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] PATH_INFO: `/v3/users/03f1ffb974d94c3ca14334dcf70f6533` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:58.196337 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f1ffb974d94c3ca14334dcf70f6533)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:58.198256 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:58.368289 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f1ffb974d94c3ca14334dcf70f6533'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:58.368922 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f1ffb974d94c3ca14334dcf70f6533'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:58.376199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f1ffb974d94c3ca14334dcf70f6533'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:58.376882 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f1ffb974d94c3ca14334dcf70f6533'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:58.428429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f1ffb974d94c3ca14334dcf70f6533'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:58.446790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1335/2701] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:33:58 2022] DELETE /identity/v3/users/03f1ffb974d94c3ca14334dcf70f6533 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:58.452113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac0d13-c43d-4cd6-b256-fdabcd35fa7c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:58.452612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac0d13-c43d-4cd6-b256-fdabcd35fa7c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:58.452772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac0d13-c43d-4cd6-b256-fdabcd35fa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:58.472859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-bdac0d13-c43d-4cd6-b256-fdabcd35fa7c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:58.474048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bdac0d13-c43d-4cd6-b256-fdabcd35fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:58.533305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1367/2702] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:58.543191 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:58.544672 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:58.602653 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9681f-8275-4631-b390-43ca2a7a85dd admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:58.606355 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2a413-1dd0-4f8a-94b5-8cb834ccc7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:58.606971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a413-1dd0-4f8a-94b5-8cb834ccc7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:58.607250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a413-1dd0-4f8a-94b5-8cb834ccc7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:58.607522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a413-1dd0-4f8a-94b5-8cb834ccc7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:58.617533 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2a413-1dd0-4f8a-94b5-8cb834ccc7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:58.619046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2a413-1dd0-4f8a-94b5-8cb834ccc7eb service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:58.628320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1336/2703] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:33:59.150566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac0d13-c43d-4cd6-b256-fdabcd35fa7c None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:59.152679 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-bdac0d13-c43d-4cd6-b256-fdabcd35fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:59.180086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac0d13-c43d-4cd6-b256-fdabcd35fa7c None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:59.180086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:59.180086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:59.180086 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:59.180456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] PATH_INFO: `/v3/projects/916131afb30a4fbfba317502a6125195` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:59.180456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=916131afb30a4fbfba317502a6125195)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:59.181230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:59.284246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916131afb30a4fbfba317502a6125195', 'request_id': 'req-8038c1a2-eb94-46d6-8419-69bfb123cc1f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:59.290858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916131afb30a4fbfba317502a6125195', 'request_id': 'req-8038c1a2-eb94-46d6-8419-69bfb123cc1f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:59.343420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916131afb30a4fbfba317502a6125195', 'request_id': 'req-8038c1a2-eb94-46d6-8419-69bfb123cc1f'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:59.354380 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] The token cache is being invalidate because project 916131afb30a4fbfba317502a6125195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:33:59.357149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:59.357149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-8038c1a2-eb94-46d6-8419-69bfb123cc1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:33:59.357149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1368/2704] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:33:59 2022] DELETE /identity/v3/projects/916131afb30a4fbfba317502a6125195 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:33:59.362017 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccecb0e-dab4-4ced-89f7-b1072ac0d485 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:59.362534 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccecb0e-dab4-4ced-89f7-b1072ac0d485 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:59.362792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccecb0e-dab4-4ced-89f7-b1072ac0d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:59.384282 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-2ccecb0e-dab4-4ced-89f7-b1072ac0d485 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:59.385497 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2ccecb0e-dab4-4ced-89f7-b1072ac0d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:59.404547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:59.454068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1337/2705] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:33:59.463365 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e156c2-1a76-426a-b98e-14c04df9d4d3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:59.463932 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e156c2-1a76-426a-b98e-14c04df9d4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:59.464171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e156c2-1a76-426a-b98e-14c04df9d4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:59.487647 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-77e156c2-1a76-426a-b98e-14c04df9d4d3 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:33:59.488844 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-77e156c2-1a76-426a-b98e-14c04df9d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:33:59.498879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1369/2706] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:33:59.503197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccecb0e-dab4-4ced-89f7-b1072ac0d485 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:59.513616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccecb0e-dab4-4ced-89f7-b1072ac0d485 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:59.520396 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f01206-481b-4329-86d1-98df075cdbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:59.521413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f01206-481b-4329-86d1-98df075cdbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:59.521413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f01206-481b-4329-86d1-98df075cdbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:59.521660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f01206-481b-4329-86d1-98df075cdbc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:59.522357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f01206-481b-4329-86d1-98df075cdbc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:33:59.522665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f01206-481b-4329-86d1-98df075cdbc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:59.524357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f01206-481b-4329-86d1-98df075cdbc9 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:59.540160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1338/2707] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:33:59.545254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e156c2-1a76-426a-b98e-14c04df9d4d3 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:59.555399 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e156c2-1a76-426a-b98e-14c04df9d4d3 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:59.560869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6207908-0d8a-4ed7-b29c-daf4decddbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:59.561477 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6207908-0d8a-4ed7-b29c-daf4decddbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:59.561748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6207908-0d8a-4ed7-b29c-daf4decddbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:59.562021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6207908-0d8a-4ed7-b29c-daf4decddbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:59.562756 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6207908-0d8a-4ed7-b29c-daf4decddbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:59.564628 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6207908-0d8a-4ed7-b29c-daf4decddbb6 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:59.660411 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1370/2708] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:33:59 2022] POST /identity/v3/projects => generated 397 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:59.664643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f01206-481b-4329-86d1-98df075cdbc9 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:59.676115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f01206-481b-4329-86d1-98df075cdbc9 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:59.745584 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7686a-c792-46e2-9ff2-b4e113ed401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:59.746211 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7686a-c792-46e2-9ff2-b4e113ed401f admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:59.746514 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7686a-c792-46e2-9ff2-b4e113ed401f admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:59.746785 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7686a-c792-46e2-9ff2-b4e113ed401f admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:59.747659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7686a-c792-46e2-9ff2-b4e113ed401f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:59.749439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7686a-c792-46e2-9ff2-b4e113ed401f admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:59.852675 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1339/2709] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:33:59 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:33:59.856996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6207908-0d8a-4ed7-b29c-daf4decddbb6 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:59.867946 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6207908-0d8a-4ed7-b29c-daf4decddbb6 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:59.872732 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99132762-acff-4222-96c0-b0fbc8b3f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:59.873393 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99132762-acff-4222-96c0-b0fbc8b3f91c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:59.873665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99132762-acff-4222-96c0-b0fbc8b3f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:59.873934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99132762-acff-4222-96c0-b0fbc8b3f91c admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:59.874703 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99132762-acff-4222-96c0-b0fbc8b3f91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:59.876684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99132762-acff-4222-96c0-b0fbc8b3f91c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:59.887607 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1371/2710] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:33:59.892500 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7686a-c792-46e2-9ff2-b4e113ed401f admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:59.902899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7686a-c792-46e2-9ff2-b4e113ed401f admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:59.908482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058aeb6-760e-4ad3-9655-400d30817101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:59.909161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058aeb6-760e-4ad3-9655-400d30817101 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:59.909503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058aeb6-760e-4ad3-9655-400d30817101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:59.909839 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058aeb6-760e-4ad3-9655-400d30817101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:59.910685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058aeb6-760e-4ad3-9655-400d30817101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:59.912342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058aeb6-760e-4ad3-9655-400d30817101 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:33:59.923804 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1340/2711] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:33:59.927958 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99132762-acff-4222-96c0-b0fbc8b3f91c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:33:59.938619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99132762-acff-4222-96c0-b0fbc8b3f91c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:33:59.943422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41842c-1c2d-4967-b9c3-09b1073cb9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:33:59.944091 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41842c-1c2d-4967-b9c3-09b1073cb9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:33:59.944796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41842c-1c2d-4967-b9c3-09b1073cb9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:33:59.944796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41842c-1c2d-4967-b9c3-09b1073cb9c7 admin admin] PATH_INFO: `/v3/projects/fa66df8329274043a4bab0e591efe2bd/users/4ee5bc0e3e4c47dc8257af667c152d9c/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:33:59.961794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41842c-1c2d-4967-b9c3-09b1073cb9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa66df8329274043a4bab0e591efe2bd, user_id=4ee5bc0e3e4c47dc8257af667c152d9c, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:33:59.964731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41842c-1c2d-4967-b9c3-09b1073cb9c7 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:00.063472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1372/2712] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:33:59 2022] PUT /identity/v3/projects/fa66df8329274043a4bab0e591efe2bd/users/4ee5bc0e3e4c47dc8257af667c152d9c/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:34:00.074006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1ee11-cc28-4b99-899b-5a2c6a0e1936 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:00.074380 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1ee11-cc28-4b99-899b-5a2c6a0e1936 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:00.074667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1ee11-cc28-4b99-899b-5a2c6a0e1936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:00.106648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8aa1ee11-cc28-4b99-899b-5a2c6a0e1936 None None] MFA Rules not processed for user `4ee5bc0e3e4c47dc8257af667c152d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:00.108079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8aa1ee11-cc28-4b99-899b-5a2c6a0e1936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:00.192481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1341/2713] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:34:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:00.204482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41842c-1c2d-4967-b9c3-09b1073cb9c7 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:00.206468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6e41842c-1c2d-4967-b9c3-09b1073cb9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:00.233997 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:00.272965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41842c-1c2d-4967-b9c3-09b1073cb9c7 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:00.276748 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe046c-74df-4bb5-ade0-d48a2a2e7c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:00.277366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe046c-74df-4bb5-ade0-d48a2a2e7c10 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:00.278801 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe046c-74df-4bb5-ade0-d48a2a2e7c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:00.279053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe046c-74df-4bb5-ade0-d48a2a2e7c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:00.288961 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe046c-74df-4bb5-ade0-d48a2a2e7c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:00.290739 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe046c-74df-4bb5-ade0-d48a2a2e7c10 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:00.301922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1373/2714] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:34:00 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:34:01.174933 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1ee11-cc28-4b99-899b-5a2c6a0e1936 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:01.177548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8aa1ee11-cc28-4b99-899b-5a2c6a0e1936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:01.220829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:01.318144 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1ee11-cc28-4b99-899b-5a2c6a0e1936 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:01.324739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038de19e-bb41-4de0-82d7-609acd5934d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:01.326544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038de19e-bb41-4de0-82d7-609acd5934d5 service placement] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:01.327030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038de19e-bb41-4de0-82d7-609acd5934d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:01.327495 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038de19e-bb41-4de0-82d7-609acd5934d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:01.330663 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-038de19e-bb41-4de0-82d7-609acd5934d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:01.343190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038de19e-bb41-4de0-82d7-609acd5934d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:01.344794 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038de19e-bb41-4de0-82d7-609acd5934d5 service placement] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:01.355206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1342/2715] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:34:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:34:03.035934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be276-2897-40ed-a08b-ac1bd7a198f5 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:03.036437 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be276-2897-40ed-a08b-ac1bd7a198f5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:03.037741 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be276-2897-40ed-a08b-ac1bd7a198f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:03.062008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-e71be276-2897-40ed-a08b-ac1bd7a198f5 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:03.063277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e71be276-2897-40ed-a08b-ac1bd7a198f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:03.126077 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1374/2716] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:34:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:03.150202 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038de19e-bb41-4de0-82d7-609acd5934d5 service placement] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:03.160346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-038de19e-bb41-4de0-82d7-609acd5934d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:03.225693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038de19e-bb41-4de0-82d7-609acd5934d5 service placement] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:03.230825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f1554-5fd1-408f-a635-767bc8f45666 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:03.231467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1554-5fd1-408f-a635-767bc8f45666 service swift] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:03.231789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1554-5fd1-408f-a635-767bc8f45666 service swift] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:03.232071 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1554-5fd1-408f-a635-767bc8f45666 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:03.241070 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f1554-5fd1-408f-a635-767bc8f45666 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:03.242785 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f1554-5fd1-408f-a635-767bc8f45666 service swift] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:03.252383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1343/2717] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:34:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:34:04.244761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803548e-eb85-41b8-98c2-747f708b7036 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:04.245277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803548e-eb85-41b8-98c2-747f708b7036 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:04.245381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803548e-eb85-41b8-98c2-747f708b7036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:04.264813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-6803548e-eb85-41b8-98c2-747f708b7036 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:04.266026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-6803548e-eb85-41b8-98c2-747f708b7036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:04.274731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1375/2718] 10.222.0.46 () {58 vars in 967 bytes} [Thu Aug 4 05:34:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:04.289037 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f1554-5fd1-408f-a635-767bc8f45666 service swift] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:04.300860 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f1554-5fd1-408f-a635-767bc8f45666 service swift] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:04.307101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ff583-b317-4240-b327-823fb8c5ceb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:04.307744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ff583-b317-4240-b327-823fb8c5ceb3 service swift] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:04.308048 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ff583-b317-4240-b327-823fb8c5ceb3 service swift] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:04.308301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ff583-b317-4240-b327-823fb8c5ceb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:04.316951 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ff583-b317-4240-b327-823fb8c5ceb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:04.318579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ff583-b317-4240-b327-823fb8c5ceb3 service swift] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:04.327365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1344/2719] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:34:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:34:04.978427 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b0c9-6416-4238-b598-6b9c11692feb None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:04.978734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b0c9-6416-4238-b598-6b9c11692feb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:04.978978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b0c9-6416-4238-b598-6b9c11692feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:04.999480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-26e3b0c9-6416-4238-b598-6b9c11692feb None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:05.000796 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-26e3b0c9-6416-4238-b598-6b9c11692feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:05.008010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1376/2720] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:34:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:05.022743 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ff583-b317-4240-b327-823fb8c5ceb3 service swift] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:05.033930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ff583-b317-4240-b327-823fb8c5ceb3 service swift] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:05.039103 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baa527-5f15-49b3-9299-fd503c3083d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:05.039785 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baa527-5f15-49b3-9299-fd503c3083d4 service swift] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:05.040130 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baa527-5f15-49b3-9299-fd503c3083d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:05.040481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baa527-5f15-49b3-9299-fd503c3083d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:05.049556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baa527-5f15-49b3-9299-fd503c3083d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:05.051353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baa527-5f15-49b3-9299-fd503c3083d4 service swift] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:05.068247 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1345/2721] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:34:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:34:05.676028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c20d61-ac7b-4e56-aee2-d15dc3389d89 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:05.676508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c20d61-ac7b-4e56-aee2-d15dc3389d89 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:05.676636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c20d61-ac7b-4e56-aee2-d15dc3389d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:05.696385 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b0c20d61-ac7b-4e56-aee2-d15dc3389d89 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:05.697788 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b0c20d61-ac7b-4e56-aee2-d15dc3389d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:05.706155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1377/2722] 10.222.0.46 () {58 vars in 967 bytes} [Thu Aug 4 05:34:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:05.720009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baa527-5f15-49b3-9299-fd503c3083d4 service swift] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:05.731158 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baa527-5f15-49b3-9299-fd503c3083d4 service swift] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:05.737040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bcab4-ae1b-49c0-b17d-ba5a92574295 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:05.737648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bcab4-ae1b-49c0-b17d-ba5a92574295 service swift] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:05.737921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bcab4-ae1b-49c0-b17d-ba5a92574295 service swift] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:05.738190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bcab4-ae1b-49c0-b17d-ba5a92574295 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:05.746649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bcab4-ae1b-49c0-b17d-ba5a92574295 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:05.748752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bcab4-ae1b-49c0-b17d-ba5a92574295 service swift] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:05.756919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1346/2723] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:34:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:34:06.276967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5c2f6-c66b-40d0-ae45-21fa39b8a5d5 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:06.277300 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5c2f6-c66b-40d0-ae45-21fa39b8a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:06.277839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5c2f6-c66b-40d0-ae45-21fa39b8a5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:06.298518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-eee5c2f6-c66b-40d0-ae45-21fa39b8a5d5 None None] MFA Rules not processed for user `fd2797b8820c41a2ae939fd7c473a549`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:06.299720 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-eee5c2f6-c66b-40d0-ae45-21fa39b8a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:06.358708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1378/2724] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:34:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:08.774496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bcab4-ae1b-49c0-b17d-ba5a92574295 service swift] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:08.816588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=100 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:08.839381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bcab4-ae1b-49c0-b17d-ba5a92574295 service swift] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:08.844923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:08.845523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:08.845788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:08.846063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] PATH_INFO: `/v3/users/4ee5bc0e3e4c47dc8257af667c152d9c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:08.847262 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee5bc0e3e4c47dc8257af667c152d9c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:08.849189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:08.996092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5c2f6-c66b-40d0-ae45-21fa39b8a5d5 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:08.997523 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-eee5c2f6-c66b-40d0-ae45-21fa39b8a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:09.011102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5c2f6-c66b-40d0-ae45-21fa39b8a5d5 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:09.016224 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:09.016846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:09.017123 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:09.017394 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] PATH_INFO: `/v3/users/f56d0ab5cf9d4c85841b57f4fe91107b` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:09.018564 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56d0ab5cf9d4c85841b57f4fe91107b)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:09.020462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:09.046619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee5bc0e3e4c47dc8257af667c152d9c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:09.047212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee5bc0e3e4c47dc8257af667c152d9c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:09.054486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee5bc0e3e4c47dc8257af667c152d9c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:09.055161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee5bc0e3e4c47dc8257af667c152d9c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:09.183633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c7c225c0-886a-446d-aa5d-816f56dec537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee5bc0e3e4c47dc8257af667c152d9c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:09.203228 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1347/2725] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:34:08 2022] DELETE /identity/v3/users/4ee5bc0e3e4c47dc8257af667c152d9c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:34:09.212013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fefba2-1482-4b36-b166-eae4fcd4f1bc None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:09.212782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fefba2-1482-4b36-b166-eae4fcd4f1bc None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:09.221481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fefba2-1482-4b36-b166-eae4fcd4f1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:09.230174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56d0ab5cf9d4c85841b57f4fe91107b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:09.231261 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56d0ab5cf9d4c85841b57f4fe91107b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:09.232865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:09.237513 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c4fefba2-1482-4b36-b166-eae4fcd4f1bc None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:09.238974 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c4fefba2-1482-4b36-b166-eae4fcd4f1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:09.240800 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56d0ab5cf9d4c85841b57f4fe91107b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:09.256366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56d0ab5cf9d4c85841b57f4fe91107b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:09.315371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1348/2726] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:09.326137 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-b0686b82-cbdc-4434-9dd4-e5c1b2ccd5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56d0ab5cf9d4c85841b57f4fe91107b'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:09.327980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fefba2-1482-4b36-b166-eae4fcd4f1bc None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:09.329545 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c4fefba2-1482-4b36-b166-eae4fcd4f1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:09.334221 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1379/2727] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:34:08 2022] DELETE /identity/v3/users/f56d0ab5cf9d4c85841b57f4fe91107b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:34:09.338552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80cb03-0268-49ed-94f1-e73f64c1a0ce None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:09.339048 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80cb03-0268-49ed-94f1-e73f64c1a0ce None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:09.339473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80cb03-0268-49ed-94f1-e73f64c1a0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:09.367553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ab80cb03-0268-49ed-94f1-e73f64c1a0ce None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:09.369426 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ab80cb03-0268-49ed-94f1-e73f64c1a0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:09.445746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fefba2-1482-4b36-b166-eae4fcd4f1bc None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:09.456457 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:09.464269 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1380/2728] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:09.474604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80cb03-0268-49ed-94f1-e73f64c1a0ce None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:09.501223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ca214-4b93-4fde-bd85-5ec54049e553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:09.501818 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ca214-4b93-4fde-bd85-5ec54049e553 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:09.502101 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ca214-4b93-4fde-bd85-5ec54049e553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:09.502406 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ca214-4b93-4fde-bd85-5ec54049e553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:09.516176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ca214-4b93-4fde-bd85-5ec54049e553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:09.517816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ca214-4b93-4fde-bd85-5ec54049e553 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:09.536819 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1349/2729] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:34:09.549705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80cb03-0268-49ed-94f1-e73f64c1a0ce None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:09.553424 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70c616-809d-44b8-b65a-92a702c160d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:09.554111 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70c616-809d-44b8-b65a-92a702c160d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:09.554402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70c616-809d-44b8-b65a-92a702c160d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:09.554672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70c616-809d-44b8-b65a-92a702c160d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:09.567129 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70c616-809d-44b8-b65a-92a702c160d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:09.569463 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70c616-809d-44b8-b65a-92a702c160d0 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:09.581869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1381/2730] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:34:10.072820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ca214-4b93-4fde-bd85-5ec54049e553 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:10.074487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b25ca214-4b93-4fde-bd85-5ec54049e553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:10.088633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ca214-4b93-4fde-bd85-5ec54049e553 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:10.093739 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:10.094549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:10.094831 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:10.095108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] PATH_INFO: `/v3/projects/2f6bda6801cf4d18abdeab209ec0037d` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:10.096284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6bda6801cf4d18abdeab209ec0037d)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:10.098183 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:10.126994 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70c616-809d-44b8-b65a-92a702c160d0 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:10.128598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0f70c616-809d-44b8-b65a-92a702c160d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:10.146685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70c616-809d-44b8-b65a-92a702c160d0 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:10.151757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:10.152663 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:10.152939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:10.153212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] PATH_INFO: `/v3/projects/fa66df8329274043a4bab0e591efe2bd` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:10.154490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa66df8329274043a4bab0e591efe2bd)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:10.156620 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:10.235423 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6bda6801cf4d18abdeab209ec0037d', 'request_id': 'req-426735fa-90d2-4a66-877d-bc07d8023e39'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:10.246013 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6bda6801cf4d18abdeab209ec0037d', 'request_id': 'req-426735fa-90d2-4a66-877d-bc07d8023e39'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:10.278024 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa66df8329274043a4bab0e591efe2bd', 'request_id': 'req-571e3910-e41d-4c38-bd9a-b92171507043'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:10.286440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa66df8329274043a4bab0e591efe2bd', 'request_id': 'req-571e3910-e41d-4c38-bd9a-b92171507043'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:10.325977 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6bda6801cf4d18abdeab209ec0037d', 'request_id': 'req-426735fa-90d2-4a66-877d-bc07d8023e39'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:10.338383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] The token cache is being invalidate because project 2f6bda6801cf4d18abdeab209ec0037d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:34:10.338676 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:10.339442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-426735fa-90d2-4a66-877d-bc07d8023e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:10.340989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1350/2731] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:34:10 2022] DELETE /identity/v3/projects/2f6bda6801cf4d18abdeab209ec0037d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:34:10.346871 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9356b-e898-4396-b912-e9105cd55489 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:10.347329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9356b-e898-4396-b912-e9105cd55489 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:10.347604 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9356b-e898-4396-b912-e9105cd55489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:10.367465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c9b9356b-e898-4396-b912-e9105cd55489 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:10.368659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c9b9356b-e898-4396-b912-e9105cd55489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:10.377571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa66df8329274043a4bab0e591efe2bd', 'request_id': 'req-571e3910-e41d-4c38-bd9a-b92171507043'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:10.380422 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:10.394613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] The token cache is being invalidate because project fa66df8329274043a4bab0e591efe2bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:34:10.394893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:10.395579 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-571e3910-e41d-4c38-bd9a-b92171507043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:34:10.397333 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1382/2732] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:34:10 2022] DELETE /identity/v3/projects/fa66df8329274043a4bab0e591efe2bd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:34:10.504200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1351/2733] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:10.517162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10f08-cdc4-4afc-b2e9-5721faacb062 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:10.517472 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10f08-cdc4-4afc-b2e9-5721faacb062 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:10.517869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10f08-cdc4-4afc-b2e9-5721faacb062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:10.542757 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ecf10f08-cdc4-4afc-b2e9-5721faacb062 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:10.544074 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ecf10f08-cdc4-4afc-b2e9-5721faacb062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:10.563907 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1383/2734] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:10.569634 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9356b-e898-4396-b912-e9105cd55489 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:10.584432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9356b-e898-4396-b912-e9105cd55489 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:10.589915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164887-bced-43e9-8b87-ba3df2e3bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:10.592392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164887-bced-43e9-8b87-ba3df2e3bec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:10.592392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164887-bced-43e9-8b87-ba3df2e3bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:10.592392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164887-bced-43e9-8b87-ba3df2e3bec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:10.592392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164887-bced-43e9-8b87-ba3df2e3bec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:34:10.592392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164887-bced-43e9-8b87-ba3df2e3bec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:10.594107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164887-bced-43e9-8b87-ba3df2e3bec9 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:10.609303 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1352/2735] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:34:10.613651 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf10f08-cdc4-4afc-b2e9-5721faacb062 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:10.624954 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf10f08-cdc4-4afc-b2e9-5721faacb062 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:10.630691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0911c96-3f8f-4b6c-b9c5-8cbbcf509511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:10.632381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0911c96-3f8f-4b6c-b9c5-8cbbcf509511 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:10.632672 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0911c96-3f8f-4b6c-b9c5-8cbbcf509511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:10.632947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0911c96-3f8f-4b6c-b9c5-8cbbcf509511 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:10.633650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0911c96-3f8f-4b6c-b9c5-8cbbcf509511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:10.635635 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0911c96-3f8f-4b6c-b9c5-8cbbcf509511 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:10.724805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1384/2736] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:34:10 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:34:10.729029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164887-bced-43e9-8b87-ba3df2e3bec9 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:10.739968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164887-bced-43e9-8b87-ba3df2e3bec9 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:10.765575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:10.800032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb69dc-d331-42fa-aa7b-2b2d30a84f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:10.800665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb69dc-d331-42fa-aa7b-2b2d30a84f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:10.801014 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb69dc-d331-42fa-aa7b-2b2d30a84f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:10.801295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb69dc-d331-42fa-aa7b-2b2d30a84f0d admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:10.801978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb69dc-d331-42fa-aa7b-2b2d30a84f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:10.804143 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb69dc-d331-42fa-aa7b-2b2d30a84f0d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:10.887689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1353/2737] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:34:10 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:34:10.893949 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0911c96-3f8f-4b6c-b9c5-8cbbcf509511 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:10.908802 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0911c96-3f8f-4b6c-b9c5-8cbbcf509511 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:10.913657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6274-e4f8-4166-8970-33849d4bba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:10.914440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6274-e4f8-4166-8970-33849d4bba47 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:10.915768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6274-e4f8-4166-8970-33849d4bba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:10.915768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6274-e4f8-4166-8970-33849d4bba47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:10.915768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6274-e4f8-4166-8970-33849d4bba47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:10.917348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6274-e4f8-4166-8970-33849d4bba47 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:10.932955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1385/2738] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:34:10.934629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb69dc-d331-42fa-aa7b-2b2d30a84f0d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:10.947333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb69dc-d331-42fa-aa7b-2b2d30a84f0d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:10.953921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ee344-0379-4736-8a67-08db7ff9f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:10.954586 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee344-0379-4736-8a67-08db7ff9f4af admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:10.954869 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee344-0379-4736-8a67-08db7ff9f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:10.955142 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee344-0379-4736-8a67-08db7ff9f4af admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:10.956227 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ee344-0379-4736-8a67-08db7ff9f4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:10.957455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ee344-0379-4736-8a67-08db7ff9f4af admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:10.968894 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1354/2739] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:34:10.973227 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6274-e4f8-4166-8970-33849d4bba47 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:10.984473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6274-e4f8-4166-8970-33849d4bba47 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:10.989969 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6dfa-9a51-4160-b146-b29b60dddfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:10.990687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6dfa-9a51-4160-b146-b29b60dddfeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:10.990976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6dfa-9a51-4160-b146-b29b60dddfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:10.991246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6dfa-9a51-4160-b146-b29b60dddfeb admin admin] PATH_INFO: `/v3/projects/c37bea771e9a4c26a19ff2ea9ed9d9b4/users/5ffe04946139486bb4b976cb0503e0aa/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:11.009026 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f6dfa-9a51-4160-b146-b29b60dddfeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37bea771e9a4c26a19ff2ea9ed9d9b4, user_id=5ffe04946139486bb4b976cb0503e0aa, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:11.011764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f6dfa-9a51-4160-b146-b29b60dddfeb admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:11.080360 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1386/2740] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:34:10 2022] PUT /identity/v3/projects/c37bea771e9a4c26a19ff2ea9ed9d9b4/users/5ffe04946139486bb4b976cb0503e0aa/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:34:11.087333 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae49f5-5d87-41ea-a1a1-f1334b0b07fd None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:11.087920 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae49f5-5d87-41ea-a1a1-f1334b0b07fd None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:11.088367 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae49f5-5d87-41ea-a1a1-f1334b0b07fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:11.114485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ebae49f5-5d87-41ea-a1a1-f1334b0b07fd None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:11.115678 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ebae49f5-5d87-41ea-a1a1-f1334b0b07fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:11.190062 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1355/2741] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:11.199768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6dfa-9a51-4160-b146-b29b60dddfeb admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:11.201908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-629f6dfa-9a51-4160-b146-b29b60dddfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:11.265316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6dfa-9a51-4160-b146-b29b60dddfeb admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:11.269330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b4853-69ee-4d46-a92a-56a540200a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:11.273321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b4853-69ee-4d46-a92a-56a540200a1e service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:11.273321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b4853-69ee-4d46-a92a-56a540200a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:11.273321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b4853-69ee-4d46-a92a-56a540200a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:11.282280 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b4853-69ee-4d46-a92a-56a540200a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:11.283768 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b4853-69ee-4d46-a92a-56a540200a1e service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:11.293985 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1387/2742] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:34:16.859630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a537a-42d0-45f4-b86a-06550dfa1da0 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:16.860208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a537a-42d0-45f4-b86a-06550dfa1da0 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:16.860313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a537a-42d0-45f4-b86a-06550dfa1da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:16.891162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-944a537a-42d0-45f4-b86a-06550dfa1da0 None None] MFA Rules not processed for user `5ffe04946139486bb4b976cb0503e0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:16.892486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-944a537a-42d0-45f4-b86a-06550dfa1da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:16.990252 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1356/2743] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:34:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:16.993973 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b4853-69ee-4d46-a92a-56a540200a1e service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:17.013473 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b4853-69ee-4d46-a92a-56a540200a1e service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:17.021724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437670d2-0167-4513-bf87-f93181f800f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:17.022727 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437670d2-0167-4513-bf87-f93181f800f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:17.023182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437670d2-0167-4513-bf87-f93181f800f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:17.023762 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437670d2-0167-4513-bf87-f93181f800f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:17.024798 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437670d2-0167-4513-bf87-f93181f800f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:17.028474 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437670d2-0167-4513-bf87-f93181f800f6 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:17.127200 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1388/2744] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:34:16 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:34:17.133385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a537a-42d0-45f4-b86a-06550dfa1da0 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:17.187093 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a537a-42d0-45f4-b86a-06550dfa1da0 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:17.262617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:17.300455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87f1eb-f4e7-41a3-8ede-c4f7ef576d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:17.301354 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87f1eb-f4e7-41a3-8ede-c4f7ef576d9d admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:17.301998 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87f1eb-f4e7-41a3-8ede-c4f7ef576d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:17.303237 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87f1eb-f4e7-41a3-8ede-c4f7ef576d9d admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:17.304173 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87f1eb-f4e7-41a3-8ede-c4f7ef576d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:17.306217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87f1eb-f4e7-41a3-8ede-c4f7ef576d9d admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:17.417958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1357/2745] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:34:17 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:34:17.422914 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437670d2-0167-4513-bf87-f93181f800f6 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:17.434244 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437670d2-0167-4513-bf87-f93181f800f6 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:17.439910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73520bb-1710-48c2-8481-68275a403dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:17.440592 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73520bb-1710-48c2-8481-68275a403dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:17.440875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73520bb-1710-48c2-8481-68275a403dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:17.441152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73520bb-1710-48c2-8481-68275a403dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:17.441948 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73520bb-1710-48c2-8481-68275a403dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:17.443648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73520bb-1710-48c2-8481-68275a403dfa admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:17.457389 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1389/2746] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:34:17.461956 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87f1eb-f4e7-41a3-8ede-c4f7ef576d9d admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:17.473595 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87f1eb-f4e7-41a3-8ede-c4f7ef576d9d admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:17.478234 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424849c-1f9f-4747-a7a2-00863fdde569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:17.479006 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424849c-1f9f-4747-a7a2-00863fdde569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:17.479280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424849c-1f9f-4747-a7a2-00863fdde569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:17.479552 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424849c-1f9f-4747-a7a2-00863fdde569 admin admin] PATH_INFO: `/v3/projects/625e0253dfcc47d6ba486169e52ee801/users/8093fe4e20804367ba3bdd3fd339266f/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:17.496598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424849c-1f9f-4747-a7a2-00863fdde569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625e0253dfcc47d6ba486169e52ee801, user_id=8093fe4e20804367ba3bdd3fd339266f, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:17.499825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424849c-1f9f-4747-a7a2-00863fdde569 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:17.576587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1358/2747] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:34:17 2022] PUT /identity/v3/projects/625e0253dfcc47d6ba486169e52ee801/users/8093fe4e20804367ba3bdd3fd339266f/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:34:17.577934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73520bb-1710-48c2-8481-68275a403dfa admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:17.588892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73520bb-1710-48c2-8481-68275a403dfa admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:17.666354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:17.675063 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4e64b-8531-494b-a3d4-b064046556bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:17.675870 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4e64b-8531-494b-a3d4-b064046556bc admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:17.676232 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4e64b-8531-494b-a3d4-b064046556bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:17.676576 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4e64b-8531-494b-a3d4-b064046556bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:17.677348 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4e64b-8531-494b-a3d4-b064046556bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:17.679849 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4e64b-8531-494b-a3d4-b064046556bc admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:17.693018 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1390/2748] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:34:17.697263 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424849c-1f9f-4747-a7a2-00863fdde569 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:17.708630 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424849c-1f9f-4747-a7a2-00863fdde569 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:17.718294 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3874e5b-049d-4f4f-8fe6-8af674c55393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:17.719240 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3874e5b-049d-4f4f-8fe6-8af674c55393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:17.719521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3874e5b-049d-4f4f-8fe6-8af674c55393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:17.719800 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3874e5b-049d-4f4f-8fe6-8af674c55393 admin admin] PATH_INFO: `/v3/projects/625e0253dfcc47d6ba486169e52ee801/users/8093fe4e20804367ba3bdd3fd339266f/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:17.721870 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3874e5b-049d-4f4f-8fe6-8af674c55393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625e0253dfcc47d6ba486169e52ee801, user_id=8093fe4e20804367ba3bdd3fd339266f, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:17.724723 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3874e5b-049d-4f4f-8fe6-8af674c55393 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:17.737688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1359/2749] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:34:17 2022] PUT /identity/v3/projects/625e0253dfcc47d6ba486169e52ee801/users/8093fe4e20804367ba3bdd3fd339266f/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:34:24.098028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd1344-b859-42cf-a136-76ce5da45997 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:24.098597 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd1344-b859-42cf-a136-76ce5da45997 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:24.098698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd1344-b859-42cf-a136-76ce5da45997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:24.131890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-00fd1344-b859-42cf-a136-76ce5da45997 None None] MFA Rules not processed for user `8093fe4e20804367ba3bdd3fd339266f`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:24.133229 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-00fd1344-b859-42cf-a136-76ce5da45997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:24.232648 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1391/2750] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:24.246735 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3874e5b-049d-4f4f-8fe6-8af674c55393 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:34:24.248874 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e3874e5b-049d-4f4f-8fe6-8af674c55393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:24.353467 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3874e5b-049d-4f4f-8fe6-8af674c55393 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:34:24.359295 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfdbb6-0f39-431e-96ce-4ef25ee3ff42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:34:24.359909 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfdbb6-0f39-431e-96ce-4ef25ee3ff42 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:24.360192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfdbb6-0f39-431e-96ce-4ef25ee3ff42 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:24.360465 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfdbb6-0f39-431e-96ce-4ef25ee3ff42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:24.416625 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfdbb6-0f39-431e-96ce-4ef25ee3ff42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:34:24.418242 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfdbb6-0f39-431e-96ce-4ef25ee3ff42 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:34:24.428092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1360/2751] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:34:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:34:34.229555 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=37 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:34.424349 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:42.819744 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0833c8-c45b-45dc-b0bb-c82134a418bd None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:34:42.820293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0833c8-c45b-45dc-b0bb-c82134a418bd None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:34:42.820293 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0833c8-c45b-45dc-b0bb-c82134a418bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:34:42.840395 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3d0833c8-c45b-45dc-b0bb-c82134a418bd None None] MFA Rules not processed for user `5ffe04946139486bb4b976cb0503e0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:34:42.841574 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3d0833c8-c45b-45dc-b0bb-c82134a418bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:34:42.849600 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1392/2752] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:34:52.834212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:03.236923 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfdbb6-0f39-431e-96ce-4ef25ee3ff42 service nova] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:35:03.293648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfdbb6-0f39-431e-96ce-4ef25ee3ff42 service nova] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:35:03.297667 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4deeb5a-57b6-4d7f-8520-b8babb0d8c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:35:03.298353 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deeb5a-57b6-4d7f-8520-b8babb0d8c9c service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:35:03.298629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deeb5a-57b6-4d7f-8520-b8babb0d8c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:35:03.298899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deeb5a-57b6-4d7f-8520-b8babb0d8c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:35:03.309521 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4deeb5a-57b6-4d7f-8520-b8babb0d8c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:35:03.311021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4deeb5a-57b6-4d7f-8520-b8babb0d8c9c service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:35:03.321641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1361/2753] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:35:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:35:10.203577 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0833c8-c45b-45dc-b0bb-c82134a418bd None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:35:10.214087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0833c8-c45b-45dc-b0bb-c82134a418bd None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:35:10.217612 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59f929-f0cf-4ca0-badf-5016f988d29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:35:10.218202 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f929-f0cf-4ca0-badf-5016f988d29c service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:35:10.218503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f929-f0cf-4ca0-badf-5016f988d29c service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:35:10.218771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f929-f0cf-4ca0-badf-5016f988d29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:35:10.220499 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-aa59f929-f0cf-4ca0-badf-5016f988d29c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:35:10.235572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59f929-f0cf-4ca0-badf-5016f988d29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:35:10.237148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59f929-f0cf-4ca0-badf-5016f988d29c service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:35:10.250461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1393/2754] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:35:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:35:11.435698 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4deeb5a-57b6-4d7f-8520-b8babb0d8c9c service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:35:11.444391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4deeb5a-57b6-4d7f-8520-b8babb0d8c9c service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:35:11.448397 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0bb2e-aeaa-4ca2-99c0-4db9ffc3df83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:35:11.449001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0bb2e-aeaa-4ca2-99c0-4db9ffc3df83 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:35:11.449279 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0bb2e-aeaa-4ca2-99c0-4db9ffc3df83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:35:11.449553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0bb2e-aeaa-4ca2-99c0-4db9ffc3df83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:35:11.451307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-90e0bb2e-aeaa-4ca2-99c0-4db9ffc3df83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:35:11.464905 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0bb2e-aeaa-4ca2-99c0-4db9ffc3df83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:35:11.466343 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0bb2e-aeaa-4ca2-99c0-4db9ffc3df83 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:35:11.477931 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1362/2755] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:35:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:35:14.424345 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6171dfd-b958-4c8a-a094-f7ad6b13bce3 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:35:14.424808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6171dfd-b958-4c8a-a094-f7ad6b13bce3 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:35:14.424916 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6171dfd-b958-4c8a-a094-f7ad6b13bce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:35:14.444831 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a6171dfd-b958-4c8a-a094-f7ad6b13bce3 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:35:14.446649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a6171dfd-b958-4c8a-a094-f7ad6b13bce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:35:14.502390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1394/2756] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:35:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:35:14.608616 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0bb2e-aeaa-4ca2-99c0-4db9ffc3df83 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:35:14.610027 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-90e0bb2e-aeaa-4ca2-99c0-4db9ffc3df83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:35:14.679358 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0bb2e-aeaa-4ca2-99c0-4db9ffc3df83 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:35:14.684878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c195e55-afe7-4ee5-9577-2011fbc2053e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:35:14.685486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c195e55-afe7-4ee5-9577-2011fbc2053e service swift] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:35:14.685760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c195e55-afe7-4ee5-9577-2011fbc2053e service swift] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:35:14.686030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c195e55-afe7-4ee5-9577-2011fbc2053e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:35:14.694164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c195e55-afe7-4ee5-9577-2011fbc2053e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:35:14.695824 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c195e55-afe7-4ee5-9577-2011fbc2053e service swift] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:35:14.704301 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1363/2757] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:35:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:35:24.495642 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=31 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:24.701179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=64 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:32.305962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6171dfd-b958-4c8a-a094-f7ad6b13bce3 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:35:32.315370 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6171dfd-b958-4c8a-a094-f7ad6b13bce3 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:35:32.318947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1024ac-7eb5-4e8d-bb4b-f0148c2e4f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:35:32.319563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1024ac-7eb5-4e8d-bb4b-f0148c2e4f34 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:35:32.319837 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1024ac-7eb5-4e8d-bb4b-f0148c2e4f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:35:32.320163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1024ac-7eb5-4e8d-bb4b-f0148c2e4f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:35:32.322571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ab1024ac-7eb5-4e8d-bb4b-f0148c2e4f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:35:32.332760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1024ac-7eb5-4e8d-bb4b-f0148c2e4f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:35:32.334188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1024ac-7eb5-4e8d-bb4b-f0148c2e4f34 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:35:32.343594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1395/2758] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:35:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:35:33.289434 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee988a-b9be-4c86-8daf-40b6bb888a0b None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:35:33.289926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee988a-b9be-4c86-8daf-40b6bb888a0b None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:35:33.290060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee988a-b9be-4c86-8daf-40b6bb888a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:35:33.340613 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-d7ee988a-b9be-4c86-8daf-40b6bb888a0b None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:35:33.341732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-d7ee988a-b9be-4c86-8daf-40b6bb888a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:35:33.358365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1364/2759] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:35:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:35:33.370890 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1024ac-7eb5-4e8d-bb4b-f0148c2e4f34 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:35:33.392619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1024ac-7eb5-4e8d-bb4b-f0148c2e4f34 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:35:33.397498 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8566ea7-f1af-449c-8710-047305b22dfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:35:33.398087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8566ea7-f1af-449c-8710-047305b22dfe service swift] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:35:33.398391 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8566ea7-f1af-449c-8710-047305b22dfe service swift] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:35:33.399258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8566ea7-f1af-449c-8710-047305b22dfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:35:33.407636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8566ea7-f1af-449c-8710-047305b22dfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:35:33.409368 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8566ea7-f1af-449c-8710-047305b22dfe service swift] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:35:33.418931 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1396/2760] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:35:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:35:43.355442 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=18 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:43.414567 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=16 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:46.886487 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d793242-72bf-4090-9931-bdda254c6185 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:35:46.887018 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d793242-72bf-4090-9931-bdda254c6185 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:35:46.887189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d793242-72bf-4090-9931-bdda254c6185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:35:46.908047 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-3d793242-72bf-4090-9931-bdda254c6185 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:35:46.909276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3d793242-72bf-4090-9931-bdda254c6185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:35:46.917814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1365/2761] 10.222.0.46 () {58 vars in 967 bytes} [Thu Aug 4 05:35:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:35:46.929864 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8566ea7-f1af-449c-8710-047305b22dfe service swift] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:35:46.941563 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8566ea7-f1af-449c-8710-047305b22dfe service swift] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:35:46.947724 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103c98-1d66-4b38-843c-b9839c5322ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:35:46.948371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103c98-1d66-4b38-843c-b9839c5322ae service swift] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:35:46.948643 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103c98-1d66-4b38-843c-b9839c5322ae service swift] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:35:46.948909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103c98-1d66-4b38-843c-b9839c5322ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:35:46.957575 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d103c98-1d66-4b38-843c-b9839c5322ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:35:46.959162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d103c98-1d66-4b38-843c-b9839c5322ae service swift] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:35:46.967986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1397/2762] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:35:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:35:56.903501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:56.965134 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=6 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:19.213167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d793242-72bf-4090-9931-bdda254c6185 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:19.214611 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3d793242-72bf-4090-9931-bdda254c6185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:19.272549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d793242-72bf-4090-9931-bdda254c6185 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:19.276537 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3301-c024-49ca-abdd-cdc136846305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:19.277154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3301-c024-49ca-abdd-cdc136846305 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:19.277432 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3301-c024-49ca-abdd-cdc136846305 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:19.277706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3301-c024-49ca-abdd-cdc136846305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:19.279486 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-257f3301-c024-49ca-abdd-cdc136846305 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:19.340792 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f3301-c024-49ca-abdd-cdc136846305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:19.342235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f3301-c024-49ca-abdd-cdc136846305 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:19.352293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1366/2763] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:22.189378 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103c98-1d66-4b38-843c-b9839c5322ae service swift] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:22.204299 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103c98-1d66-4b38-843c-b9839c5322ae service swift] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:22.211324 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d82f7-f58b-42f2-9465-86f714e16d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:22.212028 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d82f7-f58b-42f2-9465-86f714e16d7a service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:22.212352 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d82f7-f58b-42f2-9465-86f714e16d7a service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:22.212808 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d82f7-f58b-42f2-9465-86f714e16d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:22.214875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ee9d82f7-f58b-42f2-9465-86f714e16d7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:22.237990 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d82f7-f58b-42f2-9465-86f714e16d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:22.239865 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d82f7-f58b-42f2-9465-86f714e16d7a service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:22.265198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1398/2764] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:26.817029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3301-c024-49ca-abdd-cdc136846305 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:26.827802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3301-c024-49ca-abdd-cdc136846305 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:26.831563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469e80-c102-4da2-963b-86331d1d2f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:26.832181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469e80-c102-4da2-963b-86331d1d2f25 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:26.832454 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469e80-c102-4da2-963b-86331d1d2f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:26.832722 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469e80-c102-4da2-963b-86331d1d2f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:26.834526 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-42469e80-c102-4da2-963b-86331d1d2f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:26.899000 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42469e80-c102-4da2-963b-86331d1d2f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:26.900430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42469e80-c102-4da2-963b-86331d1d2f25 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:26.910321 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1367/2765] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:30.461468 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d82f7-f58b-42f2-9465-86f714e16d7a service nova] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:30.463009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ee9d82f7-f58b-42f2-9465-86f714e16d7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:30.532822 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d82f7-f58b-42f2-9465-86f714e16d7a service nova] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:30.537780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c834315-dc7d-4f1f-bbe7-a1119cb60d97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:30.538622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834315-dc7d-4f1f-bbe7-a1119cb60d97 service placement] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:30.550148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834315-dc7d-4f1f-bbe7-a1119cb60d97 service placement] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:30.550148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834315-dc7d-4f1f-bbe7-a1119cb60d97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:30.550148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8c834315-dc7d-4f1f-bbe7-a1119cb60d97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:30.552717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c834315-dc7d-4f1f-bbe7-a1119cb60d97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:30.554962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c834315-dc7d-4f1f-bbe7-a1119cb60d97 service placement] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:30.564789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1399/2766] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:30.604765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469e80-c102-4da2-963b-86331d1d2f25 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:30.606287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-42469e80-c102-4da2-963b-86331d1d2f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:30.619136 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469e80-c102-4da2-963b-86331d1d2f25 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:30.623651 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:30.624284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:30.624558 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:30.624828 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] PATH_INFO: `/v3/users/fd2797b8820c41a2ae939fd7c473a549` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:30.625970 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2797b8820c41a2ae939fd7c473a549)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:30.627904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:30.775506 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:30.778452 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2797b8820c41a2ae939fd7c473a549'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:30.779174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2797b8820c41a2ae939fd7c473a549'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:30.786374 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2797b8820c41a2ae939fd7c473a549'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:30.787019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2797b8820c41a2ae939fd7c473a549'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:30.848809 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-c72a02ee-7b7c-4f9a-90b2-83d0c3877481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2797b8820c41a2ae939fd7c473a549'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:30.868104 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1368/2767] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:36:30 2022] DELETE /identity/v3/users/fd2797b8820c41a2ae939fd7c473a549 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:31.119884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c834315-dc7d-4f1f-bbe7-a1119cb60d97 service placement] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:31.131601 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c834315-dc7d-4f1f-bbe7-a1119cb60d97 service placement] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:31.196903 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:31.197541 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:31.197812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:31.198081 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] PATH_INFO: `/v3/projects/290c5e886bf64e989f2be4b94a570e3f` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:31.199262 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290c5e886bf64e989f2be4b94a570e3f)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:31.201285 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:31.310225 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290c5e886bf64e989f2be4b94a570e3f', 'request_id': 'req-d8baefba-60c8-4a1f-89d7-de9cb2e35596'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:31.315222 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290c5e886bf64e989f2be4b94a570e3f', 'request_id': 'req-d8baefba-60c8-4a1f-89d7-de9cb2e35596'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:31.380540 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290c5e886bf64e989f2be4b94a570e3f', 'request_id': 'req-d8baefba-60c8-4a1f-89d7-de9cb2e35596'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:31.391845 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] The token cache is being invalidate because project 290c5e886bf64e989f2be4b94a570e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:36:31.392154 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:31.392752 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d8baefba-60c8-4a1f-89d7-de9cb2e35596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:31.394249 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1400/2768] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:36:31 2022] DELETE /identity/v3/projects/290c5e886bf64e989f2be4b94a570e3f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:31.400080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214b6bc-99c5-49de-91fb-c8905c208e8e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:31.400370 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214b6bc-99c5-49de-91fb-c8905c208e8e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:31.400915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214b6bc-99c5-49de-91fb-c8905c208e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:31.420825 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9214b6bc-99c5-49de-91fb-c8905c208e8e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:31.422016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9214b6bc-99c5-49de-91fb-c8905c208e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:31.480721 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1369/2769] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:31.488605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546998f-4ca9-4c01-969b-dc4521e46dc8 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:31.489113 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546998f-4ca9-4c01-969b-dc4521e46dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:31.489223 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546998f-4ca9-4c01-969b-dc4521e46dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:31.503894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:31.509923 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-e546998f-4ca9-4c01-969b-dc4521e46dc8 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:31.511169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e546998f-4ca9-4c01-969b-dc4521e46dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:31.519587 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1401/2770] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:31.524550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214b6bc-99c5-49de-91fb-c8905c208e8e None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:31.535094 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214b6bc-99c5-49de-91fb-c8905c208e8e None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:31.540023 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf2b2e-ff10-4dae-84c4-3d27598abad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:31.540737 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf2b2e-ff10-4dae-84c4-3d27598abad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:31.541016 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf2b2e-ff10-4dae-84c4-3d27598abad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:31.541329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf2b2e-ff10-4dae-84c4-3d27598abad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:31.542021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf2b2e-ff10-4dae-84c4-3d27598abad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:36:31.542357 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf2b2e-ff10-4dae-84c4-3d27598abad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:31.544077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf2b2e-ff10-4dae-84c4-3d27598abad1 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:31.555904 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1370/2771] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:36:31.560271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546998f-4ca9-4c01-969b-dc4521e46dc8 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:31.570059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546998f-4ca9-4c01-969b-dc4521e46dc8 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:31.575066 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfd3d8-adb0-4148-9c10-bd0ee70e93ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:31.575667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfd3d8-adb0-4148-9c10-bd0ee70e93ed admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:31.575943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfd3d8-adb0-4148-9c10-bd0ee70e93ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:31.576213 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfd3d8-adb0-4148-9c10-bd0ee70e93ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:31.576882 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfd3d8-adb0-4148-9c10-bd0ee70e93ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:31.578840 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfd3d8-adb0-4148-9c10-bd0ee70e93ed admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:31.684511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1402/2772] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:36:31 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:31.688516 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf2b2e-ff10-4dae-84c4-3d27598abad1 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:31.699401 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf2b2e-ff10-4dae-84c4-3d27598abad1 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:31.756418 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206db40f-94e4-403a-a19e-ae27be33c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:31.757808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206db40f-94e4-403a-a19e-ae27be33c147 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:31.757971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206db40f-94e4-403a-a19e-ae27be33c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:31.758437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206db40f-94e4-403a-a19e-ae27be33c147 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:31.758827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206db40f-94e4-403a-a19e-ae27be33c147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:31.760816 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206db40f-94e4-403a-a19e-ae27be33c147 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:31.842849 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1371/2773] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:36:31 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:31.847199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfd3d8-adb0-4148-9c10-bd0ee70e93ed admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:31.858072 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfd3d8-adb0-4148-9c10-bd0ee70e93ed admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:31.862966 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0037879-670b-4e57-a547-2270ff71647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:31.863566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0037879-670b-4e57-a547-2270ff71647d admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:31.863843 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0037879-670b-4e57-a547-2270ff71647d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:31.864169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0037879-670b-4e57-a547-2270ff71647d admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:31.864926 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0037879-670b-4e57-a547-2270ff71647d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:31.867103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0037879-670b-4e57-a547-2270ff71647d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:31.877530 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1403/2774] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:31.881707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206db40f-94e4-403a-a19e-ae27be33c147 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:31.892697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206db40f-94e4-403a-a19e-ae27be33c147 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:31.897325 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1f843-2656-41e7-93a1-404312a3a239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:31.897993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1f843-2656-41e7-93a1-404312a3a239 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:31.898330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1f843-2656-41e7-93a1-404312a3a239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:31.898628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1f843-2656-41e7-93a1-404312a3a239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:31.899315 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1f843-2656-41e7-93a1-404312a3a239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:31.901308 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1f843-2656-41e7-93a1-404312a3a239 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:31.912162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1372/2775] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:31.917057 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0037879-670b-4e57-a547-2270ff71647d admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:31.927289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0037879-670b-4e57-a547-2270ff71647d admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:31.932964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610a0fb-b244-41f5-ada6-2644e9661b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:31.933615 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610a0fb-b244-41f5-ada6-2644e9661b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:31.933894 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610a0fb-b244-41f5-ada6-2644e9661b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:31.934169 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610a0fb-b244-41f5-ada6-2644e9661b19 admin admin] PATH_INFO: `/v3/projects/5bf7bf7f733b486eafb8b3ebd3523639/users/a09a013d420a42c9bcc21c25b20a663c/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:31.949906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610a0fb-b244-41f5-ada6-2644e9661b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf7bf7f733b486eafb8b3ebd3523639, user_id=a09a013d420a42c9bcc21c25b20a663c, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:31.952543 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610a0fb-b244-41f5-ada6-2644e9661b19 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:32.037634 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1404/2776] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:36:31 2022] PUT /identity/v3/projects/5bf7bf7f733b486eafb8b3ebd3523639/users/a09a013d420a42c9bcc21c25b20a663c/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:32.054205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e52ec-c0cb-4cac-858c-b4f1d5814932 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:32.054205 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e52ec-c0cb-4cac-858c-b4f1d5814932 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:32.055106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e52ec-c0cb-4cac-858c-b4f1d5814932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:32.083473 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-b64e52ec-c0cb-4cac-858c-b4f1d5814932 None None] MFA Rules not processed for user `a09a013d420a42c9bcc21c25b20a663c`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:32.084707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b64e52ec-c0cb-4cac-858c-b4f1d5814932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:32.097119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:32.150853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1373/2777] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:32.162454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610a0fb-b244-41f5-ada6-2644e9661b19 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:32.165321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-5610a0fb-b244-41f5-ada6-2644e9661b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:32.241910 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610a0fb-b244-41f5-ada6-2644e9661b19 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:32.247384 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e417-9381-4f13-8dbb-61945cb66d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:32.248001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e417-9381-4f13-8dbb-61945cb66d31 service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:32.248282 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e417-9381-4f13-8dbb-61945cb66d31 service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:32.248557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e417-9381-4f13-8dbb-61945cb66d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:32.256692 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2e417-9381-4f13-8dbb-61945cb66d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:32.258832 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2e417-9381-4f13-8dbb-61945cb66d31 service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:32.267800 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1405/2778] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:35.457784 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e52ec-c0cb-4cac-858c-b4f1d5814932 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:35.517702 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e52ec-c0cb-4cac-858c-b4f1d5814932 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:35.522108 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:35.523365 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:35.523642 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:35.523917 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] PATH_INFO: `/v3/users/a09a013d420a42c9bcc21c25b20a663c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:35.525077 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09a013d420a42c9bcc21c25b20a663c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:35.527264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:35.662687 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09a013d420a42c9bcc21c25b20a663c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:35.663948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09a013d420a42c9bcc21c25b20a663c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:35.670910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09a013d420a42c9bcc21c25b20a663c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:35.671481 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09a013d420a42c9bcc21c25b20a663c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:35.722741 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09a013d420a42c9bcc21c25b20a663c'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:35.742985 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1374/2779] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:36:35 2022] DELETE /identity/v3/users/a09a013d420a42c9bcc21c25b20a663c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:35.747604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe2d10-3e1e-4bac-81c5-e2bfdb52b349 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:35.748106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe2d10-3e1e-4bac-81c5-e2bfdb52b349 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:35.748215 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe2d10-3e1e-4bac-81c5-e2bfdb52b349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:35.766747 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-a9fe2d10-3e1e-4bac-81c5-e2bfdb52b349 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:35.767938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a9fe2d10-3e1e-4bac-81c5-e2bfdb52b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:35.826708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1406/2780] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:35.837120 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:35.838575 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:35.878439 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:35.894842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cdb02-ac28-4a1c-80d8-4509ad840e98 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:35.899063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a7fbd-5849-4d8f-a0ca-fa93a0c826a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:35.899674 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a7fbd-5849-4d8f-a0ca-fa93a0c826a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:35.899948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a7fbd-5849-4d8f-a0ca-fa93a0c826a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:35.900215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a7fbd-5849-4d8f-a0ca-fa93a0c826a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:35.909713 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a7fbd-5849-4d8f-a0ca-fa93a0c826a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:35.911174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a7fbd-5849-4d8f-a0ca-fa93a0c826a6 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:35.921383 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1375/2781] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:36.321144 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe2d10-3e1e-4bac-81c5-e2bfdb52b349 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:36.322637 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a9fe2d10-3e1e-4bac-81c5-e2bfdb52b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:36.334940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe2d10-3e1e-4bac-81c5-e2bfdb52b349 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:36.339812 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:36.345434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:36.345434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:36.345434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] PATH_INFO: `/v3/projects/5bf7bf7f733b486eafb8b3ebd3523639` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:36.345434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf7bf7f733b486eafb8b3ebd3523639)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:36.345434 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:36.360728 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:36.438619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf7bf7f733b486eafb8b3ebd3523639', 'request_id': 'req-c6b3ba56-9312-4b84-9453-68bcbf67a260'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:36.445301 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf7bf7f733b486eafb8b3ebd3523639', 'request_id': 'req-c6b3ba56-9312-4b84-9453-68bcbf67a260'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:36.505966 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf7bf7f733b486eafb8b3ebd3523639', 'request_id': 'req-c6b3ba56-9312-4b84-9453-68bcbf67a260'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:36.518266 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] The token cache is being invalidate because project 5bf7bf7f733b486eafb8b3ebd3523639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:36:36.518571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:36.519193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c6b3ba56-9312-4b84-9453-68bcbf67a260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:36.520697 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1407/2782] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:36:36 2022] DELETE /identity/v3/projects/5bf7bf7f733b486eafb8b3ebd3523639 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:36.526455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477cfe4-42df-42cf-8870-f51883072b30 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:36.526962 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477cfe4-42df-42cf-8870-f51883072b30 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:36.527068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477cfe4-42df-42cf-8870-f51883072b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:36.547887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e477cfe4-42df-42cf-8870-f51883072b30 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:36.549054 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e477cfe4-42df-42cf-8870-f51883072b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:36.606991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1376/2783] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:36.615892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9690a-7124-4b47-bca1-554f54699512 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:36.616402 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9690a-7124-4b47-bca1-554f54699512 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:36.616590 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9690a-7124-4b47-bca1-554f54699512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:36.636570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-afc9690a-7124-4b47-bca1-554f54699512 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:36.637767 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-afc9690a-7124-4b47-bca1-554f54699512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:36.646963 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1408/2784] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:36.652160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477cfe4-42df-42cf-8870-f51883072b30 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:36.661802 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477cfe4-42df-42cf-8870-f51883072b30 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:36.667617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29d3a-43c3-4340-bb08-fe0a29abb072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:36.668290 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29d3a-43c3-4340-bb08-fe0a29abb072 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:36.668568 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29d3a-43c3-4340-bb08-fe0a29abb072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:36.668842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29d3a-43c3-4340-bb08-fe0a29abb072 admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:36.669542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad29d3a-43c3-4340-bb08-fe0a29abb072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:36:36.669875 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad29d3a-43c3-4340-bb08-fe0a29abb072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:36.671570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad29d3a-43c3-4340-bb08-fe0a29abb072 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:36.683529 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1377/2785] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:36:36.687960 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9690a-7124-4b47-bca1-554f54699512 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:36.698388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9690a-7124-4b47-bca1-554f54699512 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:36.703053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84febdc-1440-4568-bc38-a852eab35b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:36.703780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84febdc-1440-4568-bc38-a852eab35b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:36.704054 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84febdc-1440-4568-bc38-a852eab35b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:36.704408 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84febdc-1440-4568-bc38-a852eab35b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:36.705067 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84febdc-1440-4568-bc38-a852eab35b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:36.706982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84febdc-1440-4568-bc38-a852eab35b70 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:36.804233 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1409/2786] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:36:36 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:36.808459 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29d3a-43c3-4340-bb08-fe0a29abb072 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:36.818469 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29d3a-43c3-4340-bb08-fe0a29abb072 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:36.873580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abcfba-2265-4825-aa83-f5b03989ea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:36.874182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abcfba-2265-4825-aa83-f5b03989ea33 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:36.874488 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abcfba-2265-4825-aa83-f5b03989ea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:36.874757 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abcfba-2265-4825-aa83-f5b03989ea33 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:36.875420 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abcfba-2265-4825-aa83-f5b03989ea33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:36.877341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abcfba-2265-4825-aa83-f5b03989ea33 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:36.933778 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1378/2787] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:36:36 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:36.938039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84febdc-1440-4568-bc38-a852eab35b70 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:36.949008 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84febdc-1440-4568-bc38-a852eab35b70 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:36.953535 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe7c25-19b4-4564-9f9d-edb15009db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:36.954135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe7c25-19b4-4564-9f9d-edb15009db02 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:36.954441 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe7c25-19b4-4564-9f9d-edb15009db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:36.954717 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe7c25-19b4-4564-9f9d-edb15009db02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:36.955405 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe7c25-19b4-4564-9f9d-edb15009db02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:36.957024 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe7c25-19b4-4564-9f9d-edb15009db02 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:36.967661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1410/2788] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:36.976659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abcfba-2265-4825-aa83-f5b03989ea33 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:36.981982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abcfba-2265-4825-aa83-f5b03989ea33 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:36.986841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddccee6-ed95-4e86-999a-cd392719eee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:36.987453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddccee6-ed95-4e86-999a-cd392719eee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:36.987732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddccee6-ed95-4e86-999a-cd392719eee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:36.988008 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddccee6-ed95-4e86-999a-cd392719eee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:36.988697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddccee6-ed95-4e86-999a-cd392719eee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:36.990421 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddccee6-ed95-4e86-999a-cd392719eee9 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:37.000971 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1379/2789] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:36:37.005009 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe7c25-19b4-4564-9f9d-edb15009db02 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:37.015354 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe7c25-19b4-4564-9f9d-edb15009db02 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:37.019955 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e77af-a2d0-4d0d-a02c-cd73c2a9392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:37.020599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e77af-a2d0-4d0d-a02c-cd73c2a9392c admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:37.020874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e77af-a2d0-4d0d-a02c-cd73c2a9392c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:37.021148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e77af-a2d0-4d0d-a02c-cd73c2a9392c admin admin] PATH_INFO: `/v3/projects/9b1213da959b48d283c913b22fb29db8/users/cad2ef05c9d2430f9f3b84fc4cd47fed/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:37.036850 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e77af-a2d0-4d0d-a02c-cd73c2a9392c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1213da959b48d283c913b22fb29db8, user_id=cad2ef05c9d2430f9f3b84fc4cd47fed, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:37.039688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e77af-a2d0-4d0d-a02c-cd73c2a9392c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:37.117151 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1411/2790] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:36:37 2022] PUT /identity/v3/projects/9b1213da959b48d283c913b22fb29db8/users/cad2ef05c9d2430f9f3b84fc4cd47fed/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:37.127746 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc9526-7a93-4906-9924-0b6ee3b655d2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:37.128032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc9526-7a93-4906-9924-0b6ee3b655d2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:37.128307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc9526-7a93-4906-9924-0b6ee3b655d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:37.156199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-7cdc9526-7a93-4906-9924-0b6ee3b655d2 None None] MFA Rules not processed for user `cad2ef05c9d2430f9f3b84fc4cd47fed`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:37.157406 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-7cdc9526-7a93-4906-9924-0b6ee3b655d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:37.190011 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:37.221879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1380/2791] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:37.226878 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e77af-a2d0-4d0d-a02c-cd73c2a9392c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:37.288547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e77af-a2d0-4d0d-a02c-cd73c2a9392c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:37.293100 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c61c-1b3c-496e-a077-73ae9b29374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:37.293691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c61c-1b3c-496e-a077-73ae9b29374c admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:37.293962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c61c-1b3c-496e-a077-73ae9b29374c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:37.294226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c61c-1b3c-496e-a077-73ae9b29374c admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:37.294902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6c61c-1b3c-496e-a077-73ae9b29374c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:37.296770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6c61c-1b3c-496e-a077-73ae9b29374c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:37.387503 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1412/2792] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:36:37 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:37.391731 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc9526-7a93-4906-9924-0b6ee3b655d2 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:37.402822 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc9526-7a93-4906-9924-0b6ee3b655d2 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:37.458273 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76ad22-1aa0-486b-bdf6-994d5be7a4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:37.458937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76ad22-1aa0-486b-bdf6-994d5be7a4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:37.459215 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76ad22-1aa0-486b-bdf6-994d5be7a4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:37.459485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76ad22-1aa0-486b-bdf6-994d5be7a4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:37.460140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76ad22-1aa0-486b-bdf6-994d5be7a4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:37.462035 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76ad22-1aa0-486b-bdf6-994d5be7a4c7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:37.568227 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1381/2793] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:36:37 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:37.572205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c61c-1b3c-496e-a077-73ae9b29374c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:37.582511 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c61c-1b3c-496e-a077-73ae9b29374c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:37.587211 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde296bd-de56-47ed-bbdf-5619fd0e3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:37.587813 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde296bd-de56-47ed-bbdf-5619fd0e3fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:37.588087 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde296bd-de56-47ed-bbdf-5619fd0e3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:37.588353 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde296bd-de56-47ed-bbdf-5619fd0e3fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:37.589079 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde296bd-de56-47ed-bbdf-5619fd0e3fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:37.590740 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde296bd-de56-47ed-bbdf-5619fd0e3fdb admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:37.601669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1413/2794] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:37.605688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76ad22-1aa0-486b-bdf6-994d5be7a4c7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:37.615791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76ad22-1aa0-486b-bdf6-994d5be7a4c7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:37.621271 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddebdc1-2b9f-4105-93fb-a5a99a349b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:37.621926 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddebdc1-2b9f-4105-93fb-a5a99a349b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:37.622209 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddebdc1-2b9f-4105-93fb-a5a99a349b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:37.622509 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddebdc1-2b9f-4105-93fb-a5a99a349b2a admin admin] PATH_INFO: `/v3/projects/b7f2489f0d1d487a8e2daae818f0ddfe/users/b8e7ed75aef646499c768992daa96be1/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:37.636892 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddebdc1-2b9f-4105-93fb-a5a99a349b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2489f0d1d487a8e2daae818f0ddfe, user_id=b8e7ed75aef646499c768992daa96be1, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:37.639605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddebdc1-2b9f-4105-93fb-a5a99a349b2a admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:37.740200 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1382/2795] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:36:37 2022] PUT /identity/v3/projects/b7f2489f0d1d487a8e2daae818f0ddfe/users/b8e7ed75aef646499c768992daa96be1/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:37.744987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde296bd-de56-47ed-bbdf-5619fd0e3fdb admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:37.755061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde296bd-de56-47ed-bbdf-5619fd0e3fdb admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:37.763834 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:37.812710 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa504f4-87b9-42e3-94ba-3378c41f57a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:37.813439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa504f4-87b9-42e3-94ba-3378c41f57a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:37.813690 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa504f4-87b9-42e3-94ba-3378c41f57a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:37.813959 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa504f4-87b9-42e3-94ba-3378c41f57a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:37.814666 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa504f4-87b9-42e3-94ba-3378c41f57a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:37.816246 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa504f4-87b9-42e3-94ba-3378c41f57a4 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:37.826435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1414/2796] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:37.830387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddebdc1-2b9f-4105-93fb-a5a99a349b2a admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:37.841250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddebdc1-2b9f-4105-93fb-a5a99a349b2a admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:37.845885 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9a793-5194-41e8-a158-b70a013dd8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:37.846579 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9a793-5194-41e8-a158-b70a013dd8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:37.846862 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9a793-5194-41e8-a158-b70a013dd8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:37.847139 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9a793-5194-41e8-a158-b70a013dd8ec admin admin] PATH_INFO: `/v3/projects/b7f2489f0d1d487a8e2daae818f0ddfe/users/b8e7ed75aef646499c768992daa96be1/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:37.849090 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9a793-5194-41e8-a158-b70a013dd8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f2489f0d1d487a8e2daae818f0ddfe, user_id=b8e7ed75aef646499c768992daa96be1, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:37.852346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9a793-5194-41e8-a158-b70a013dd8ec admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:37.862437 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1383/2797] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:36:37 2022] PUT /identity/v3/projects/b7f2489f0d1d487a8e2daae818f0ddfe/users/b8e7ed75aef646499c768992daa96be1/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:37.872771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78af9d-a1ed-4769-826a-c1a6b827c935 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:37.873076 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78af9d-a1ed-4769-826a-c1a6b827c935 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:37.873349 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78af9d-a1ed-4769-826a-c1a6b827c935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:37.901581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-8e78af9d-a1ed-4769-826a-c1a6b827c935 None None] MFA Rules not processed for user `b8e7ed75aef646499c768992daa96be1`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:37.902797 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-8e78af9d-a1ed-4769-826a-c1a6b827c935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:37.969888 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1415/2798] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:37.982993 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9a793-5194-41e8-a158-b70a013dd8ec admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:37.984679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-98c9a793-5194-41e8-a158-b70a013dd8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:38.044726 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9a793-5194-41e8-a158-b70a013dd8ec admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:38.050132 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2345cc5-c57c-4322-bd65-676745145b78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:38.051377 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2345cc5-c57c-4322-bd65-676745145b78 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:38.051682 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2345cc5-c57c-4322-bd65-676745145b78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:38.051960 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2345cc5-c57c-4322-bd65-676745145b78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:38.061496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2345cc5-c57c-4322-bd65-676745145b78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:38.062968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2345cc5-c57c-4322-bd65-676745145b78 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:38.072541 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1384/2799] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:38.101794 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78af9d-a1ed-4769-826a-c1a6b827c935 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:38.174938 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78af9d-a1ed-4769-826a-c1a6b827c935 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:38.180902 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:38.181546 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:38.181823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:38.182089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] PATH_INFO: `/v3/users/cad2ef05c9d2430f9f3b84fc4cd47fed` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:38.183294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad2ef05c9d2430f9f3b84fc4cd47fed)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:38.185190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:38.374992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:38.386286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad2ef05c9d2430f9f3b84fc4cd47fed'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:38.387316 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad2ef05c9d2430f9f3b84fc4cd47fed'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:38.395318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad2ef05c9d2430f9f3b84fc4cd47fed'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:38.408684 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad2ef05c9d2430f9f3b84fc4cd47fed'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:38.500276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad2ef05c9d2430f9f3b84fc4cd47fed'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:38.507674 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1416/2800] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:36:38 2022] DELETE /identity/v3/users/cad2ef05c9d2430f9f3b84fc4cd47fed => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:38.512187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7342971-f88a-4f9f-b122-343d41714850 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:38.512479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7342971-f88a-4f9f-b122-343d41714850 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:38.515628 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7342971-f88a-4f9f-b122-343d41714850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:38.535760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-e7342971-f88a-4f9f-b122-343d41714850 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:38.536958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e7342971-f88a-4f9f-b122-343d41714850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:38.568145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:38.608249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1385/2801] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:38.619970 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:38.621459 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:38.680866 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3738482-b11d-4fca-80a8-ae9af50591b0 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:38.685117 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d39490-2ebf-4608-ba3b-9b8496645373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:38.686001 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d39490-2ebf-4608-ba3b-9b8496645373 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:38.686276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d39490-2ebf-4608-ba3b-9b8496645373 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:38.686593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d39490-2ebf-4608-ba3b-9b8496645373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:38.700469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d39490-2ebf-4608-ba3b-9b8496645373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:38.701908 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d39490-2ebf-4608-ba3b-9b8496645373 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:38.711806 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1417/2802] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:39.136788 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7342971-f88a-4f9f-b122-343d41714850 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:39.138366 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e7342971-f88a-4f9f-b122-343d41714850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:39.153140 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7342971-f88a-4f9f-b122-343d41714850 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:39.158001 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:39.168068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:39.168068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:39.168068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] PATH_INFO: `/v3/projects/9b1213da959b48d283c913b22fb29db8` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:39.168068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1213da959b48d283c913b22fb29db8)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:39.168068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:39.294760 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1213da959b48d283c913b22fb29db8', 'request_id': 'req-e5a43c81-18c2-4047-97b4-b4fdace34d26'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:39.300921 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1213da959b48d283c913b22fb29db8', 'request_id': 'req-e5a43c81-18c2-4047-97b4-b4fdace34d26'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:39.374204 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1213da959b48d283c913b22fb29db8', 'request_id': 'req-e5a43c81-18c2-4047-97b4-b4fdace34d26'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:39.385348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] The token cache is being invalidate because project 9b1213da959b48d283c913b22fb29db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:36:39.385638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:39.386267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:39.387808 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1386/2803] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:36:39 2022] DELETE /identity/v3/projects/9b1213da959b48d283c913b22fb29db8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:39.391875 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d39490-2ebf-4608-ba3b-9b8496645373 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:39.401712 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d39490-2ebf-4608-ba3b-9b8496645373 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:39.458288 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:39.458942 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:39.459217 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:39.459490 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] PATH_INFO: `/v3/users/b8e7ed75aef646499c768992daa96be1` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:39.460654 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e7ed75aef646499c768992daa96be1)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:39.462598 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:39.615925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e7ed75aef646499c768992daa96be1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:39.616481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e7ed75aef646499c768992daa96be1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:39.624275 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e7ed75aef646499c768992daa96be1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:39.626070 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:39.637104 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e7ed75aef646499c768992daa96be1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:39.676965 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-652fff54-621c-417b-a60d-920b11c35e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e7ed75aef646499c768992daa96be1'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:39.683251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1418/2804] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:36:39 2022] DELETE /identity/v3/users/b8e7ed75aef646499c768992daa96be1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:40.049807 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:40.051293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:40.065623 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a43c81-18c2-4047-97b4-b4fdace34d26 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:40.125633 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:40.126400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:40.126734 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:40.126958 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] PATH_INFO: `/v3/projects/b7f2489f0d1d487a8e2daae818f0ddfe` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:40.128121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f2489f0d1d487a8e2daae818f0ddfe)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:40.130029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:40.232330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f2489f0d1d487a8e2daae818f0ddfe', 'request_id': 'req-8dca4a73-8c76-4565-8005-b2181389c2e6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:40.238398 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f2489f0d1d487a8e2daae818f0ddfe', 'request_id': 'req-8dca4a73-8c76-4565-8005-b2181389c2e6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:40.240032 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:40.311250 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f2489f0d1d487a8e2daae818f0ddfe', 'request_id': 'req-8dca4a73-8c76-4565-8005-b2181389c2e6'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:40.322330 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] The token cache is being invalidate because project b7f2489f0d1d487a8e2daae818f0ddfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:36:40.322658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:40.323307 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-8dca4a73-8c76-4565-8005-b2181389c2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:40.324847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1387/2805] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:36:40 2022] DELETE /identity/v3/projects/b7f2489f0d1d487a8e2daae818f0ddfe => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:40.329900 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10c23d-342d-417c-9bf0-dbc13fe8bf65 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:40.330183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10c23d-342d-417c-9bf0-dbc13fe8bf65 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:40.330496 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10c23d-342d-417c-9bf0-dbc13fe8bf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:40.350633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-4d10c23d-342d-417c-9bf0-dbc13fe8bf65 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:40.352562 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-4d10c23d-342d-417c-9bf0-dbc13fe8bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:40.412012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1419/2806] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:40.419878 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6c972-ccc4-4d42-851d-b4ca7085b9aa None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:40.420168 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6c972-ccc4-4d42-851d-b4ca7085b9aa None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:40.420447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6c972-ccc4-4d42-851d-b4ca7085b9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:40.439707 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-37f6c972-ccc4-4d42-851d-b4ca7085b9aa None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:40.440907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-37f6c972-ccc4-4d42-851d-b4ca7085b9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:40.449356 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1388/2807] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:40.453561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10c23d-342d-417c-9bf0-dbc13fe8bf65 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:40.463924 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10c23d-342d-417c-9bf0-dbc13fe8bf65 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:40.468638 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a55a2e-b5cb-404f-b3cc-bc642b63578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:40.469445 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a55a2e-b5cb-404f-b3cc-bc642b63578f admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:40.469605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a55a2e-b5cb-404f-b3cc-bc642b63578f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:40.469918 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a55a2e-b5cb-404f-b3cc-bc642b63578f admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:40.470636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a55a2e-b5cb-404f-b3cc-bc642b63578f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:36:40.470936 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a55a2e-b5cb-404f-b3cc-bc642b63578f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:40.472547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a55a2e-b5cb-404f-b3cc-bc642b63578f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:40.484304 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1420/2808] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:36:40.488531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6c972-ccc4-4d42-851d-b4ca7085b9aa None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:40.497986 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6c972-ccc4-4d42-851d-b4ca7085b9aa None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:40.502706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7466c-79b3-4033-9c42-c6c1e8532e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:40.506081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7466c-79b3-4033-9c42-c6c1e8532e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:40.506081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7466c-79b3-4033-9c42-c6c1e8532e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:40.506081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7466c-79b3-4033-9c42-c6c1e8532e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:40.506081 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7466c-79b3-4033-9c42-c6c1e8532e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:40.506527 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7466c-79b3-4033-9c42-c6c1e8532e89 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:40.592708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1389/2809] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:36:40 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:36:40.596873 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a55a2e-b5cb-404f-b3cc-bc642b63578f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:40.607199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a55a2e-b5cb-404f-b3cc-bc642b63578f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:40.662435 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bbe49-02dd-497a-9202-acd02e1e4dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:40.662977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bbe49-02dd-497a-9202-acd02e1e4dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:40.663259 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bbe49-02dd-497a-9202-acd02e1e4dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:40.663531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bbe49-02dd-497a-9202-acd02e1e4dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:40.664934 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bbe49-02dd-497a-9202-acd02e1e4dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:40.667097 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bbe49-02dd-497a-9202-acd02e1e4dc7 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:40.774698 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1421/2810] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:36:40 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:40.779072 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7466c-79b3-4033-9c42-c6c1e8532e89 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:40.789700 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7466c-79b3-4033-9c42-c6c1e8532e89 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:40.794223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e72ea-148a-4a31-8320-390bbb4fe624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:40.794844 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e72ea-148a-4a31-8320-390bbb4fe624 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:40.795178 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e72ea-148a-4a31-8320-390bbb4fe624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:40.795453 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e72ea-148a-4a31-8320-390bbb4fe624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:40.796201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e72ea-148a-4a31-8320-390bbb4fe624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:40.797782 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e72ea-148a-4a31-8320-390bbb4fe624 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:40.808283 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1390/2811] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:40.812068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bbe49-02dd-497a-9202-acd02e1e4dc7 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:40.823112 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bbe49-02dd-497a-9202-acd02e1e4dc7 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:40.827826 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b8294-cad0-4491-bca1-598848af7bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:40.828425 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b8294-cad0-4491-bca1-598848af7bad admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:40.828705 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b8294-cad0-4491-bca1-598848af7bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:40.828978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b8294-cad0-4491-bca1-598848af7bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:40.829665 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b8294-cad0-4491-bca1-598848af7bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:40.831278 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b8294-cad0-4491-bca1-598848af7bad admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:40.842770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1422/2812] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:40.846834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e72ea-148a-4a31-8320-390bbb4fe624 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:40.857658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e72ea-148a-4a31-8320-390bbb4fe624 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:40.862409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823ae18-da7e-4979-adc2-fd8afb6b1ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:40.863100 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823ae18-da7e-4979-adc2-fd8afb6b1ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:40.863374 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823ae18-da7e-4979-adc2-fd8afb6b1ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:40.863880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823ae18-da7e-4979-adc2-fd8afb6b1ec7 admin admin] PATH_INFO: `/v3/projects/097573d014fb4448b11ec6635d36bb3c/users/0116536bd021431dbeda3b50a8f868a6/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:40.878810 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823ae18-da7e-4979-adc2-fd8afb6b1ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097573d014fb4448b11ec6635d36bb3c, user_id=0116536bd021431dbeda3b50a8f868a6, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:40.881447 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823ae18-da7e-4979-adc2-fd8afb6b1ec7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:40.968913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1391/2813] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:36:40 2022] PUT /identity/v3/projects/097573d014fb4448b11ec6635d36bb3c/users/0116536bd021431dbeda3b50a8f868a6/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:40.979305 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa5af8-80b7-4305-9c85-dd9efd31c751 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:40.979589 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa5af8-80b7-4305-9c85-dd9efd31c751 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:40.979869 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa5af8-80b7-4305-9c85-dd9efd31c751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:41.008450 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-25fa5af8-80b7-4305-9c85-dd9efd31c751 None None] MFA Rules not processed for user `0116536bd021431dbeda3b50a8f868a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:41.009700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-25fa5af8-80b7-4305-9c85-dd9efd31c751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:41.039913 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:41.073764 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1423/2814] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:41.078400 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823ae18-da7e-4979-adc2-fd8afb6b1ec7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:41.140896 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823ae18-da7e-4979-adc2-fd8afb6b1ec7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:41.145549 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598262ac-16bb-405c-acb0-c6d58df76557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:41.146162 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598262ac-16bb-405c-acb0-c6d58df76557 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:41.146484 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598262ac-16bb-405c-acb0-c6d58df76557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:41.146762 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598262ac-16bb-405c-acb0-c6d58df76557 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:41.147430 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598262ac-16bb-405c-acb0-c6d58df76557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:41.150109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598262ac-16bb-405c-acb0-c6d58df76557 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:41.238407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1392/2815] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:36:41 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:41.242867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa5af8-80b7-4305-9c85-dd9efd31c751 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:41.253983 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa5af8-80b7-4305-9c85-dd9efd31c751 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:41.309972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b8c5c-955a-4f1d-9360-f0a21b4d56cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:41.310922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b8c5c-955a-4f1d-9360-f0a21b4d56cd admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:41.311207 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b8c5c-955a-4f1d-9360-f0a21b4d56cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:41.311478 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b8c5c-955a-4f1d-9360-f0a21b4d56cd admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:41.312130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b8c5c-955a-4f1d-9360-f0a21b4d56cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:41.314120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b8c5c-955a-4f1d-9360-f0a21b4d56cd admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:41.385995 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1424/2816] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:36:41 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:41.390106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598262ac-16bb-405c-acb0-c6d58df76557 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:41.401214 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598262ac-16bb-405c-acb0-c6d58df76557 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:41.405842 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfa91c-e072-4a73-8ce5-dd8b091feab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:41.406479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa91c-e072-4a73-8ce5-dd8b091feab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:41.407005 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa91c-e072-4a73-8ce5-dd8b091feab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:41.407119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa91c-e072-4a73-8ce5-dd8b091feab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:41.407742 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfa91c-e072-4a73-8ce5-dd8b091feab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:41.409317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfa91c-e072-4a73-8ce5-dd8b091feab7 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:41.419854 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1393/2817] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:41.423859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b8c5c-955a-4f1d-9360-f0a21b4d56cd admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:41.434061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b8c5c-955a-4f1d-9360-f0a21b4d56cd admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:41.438636 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12759185-8cf3-4b54-96dc-60cf8d51c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:41.439278 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12759185-8cf3-4b54-96dc-60cf8d51c55d admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:41.439551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12759185-8cf3-4b54-96dc-60cf8d51c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:41.439820 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12759185-8cf3-4b54-96dc-60cf8d51c55d admin admin] PATH_INFO: `/v3/projects/7cd6a7e8adba4b4eb1900dc3d88fe86a/users/19c901ae31584d32abf1e632750c8236/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:41.455017 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12759185-8cf3-4b54-96dc-60cf8d51c55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd6a7e8adba4b4eb1900dc3d88fe86a, user_id=19c901ae31584d32abf1e632750c8236, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:41.457771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12759185-8cf3-4b54-96dc-60cf8d51c55d admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:41.583716 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1425/2818] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:36:41 2022] PUT /identity/v3/projects/7cd6a7e8adba4b4eb1900dc3d88fe86a/users/19c901ae31584d32abf1e632750c8236/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:41.607587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfa91c-e072-4a73-8ce5-dd8b091feab7 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:41.607587 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfa91c-e072-4a73-8ce5-dd8b091feab7 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:41.652313 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:41.660911 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083228bf-17a3-4ec0-9ca7-ac93aa9796a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:41.661548 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083228bf-17a3-4ec0-9ca7-ac93aa9796a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:41.661829 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083228bf-17a3-4ec0-9ca7-ac93aa9796a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:41.662107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083228bf-17a3-4ec0-9ca7-ac93aa9796a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:41.662843 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083228bf-17a3-4ec0-9ca7-ac93aa9796a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:41.664500 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083228bf-17a3-4ec0-9ca7-ac93aa9796a0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:41.674373 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1394/2819] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:41.679780 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12759185-8cf3-4b54-96dc-60cf8d51c55d admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:41.690198 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12759185-8cf3-4b54-96dc-60cf8d51c55d admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:41.695661 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76675d2c-2d77-4191-baec-9e38271e8746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:41.696327 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76675d2c-2d77-4191-baec-9e38271e8746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:41.696608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76675d2c-2d77-4191-baec-9e38271e8746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:41.696909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76675d2c-2d77-4191-baec-9e38271e8746 admin admin] PATH_INFO: `/v3/projects/7cd6a7e8adba4b4eb1900dc3d88fe86a/users/19c901ae31584d32abf1e632750c8236/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:41.699021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76675d2c-2d77-4191-baec-9e38271e8746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd6a7e8adba4b4eb1900dc3d88fe86a, user_id=19c901ae31584d32abf1e632750c8236, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:41.704153 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76675d2c-2d77-4191-baec-9e38271e8746 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:41.712443 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1426/2820] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:36:41 2022] PUT /identity/v3/projects/7cd6a7e8adba4b4eb1900dc3d88fe86a/users/19c901ae31584d32abf1e632750c8236/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:41.776821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d55e-59c8-4681-974e-f47a5367857e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:41.777107 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d55e-59c8-4681-974e-f47a5367857e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:41.777387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d55e-59c8-4681-974e-f47a5367857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:41.807522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-4a04d55e-59c8-4681-974e-f47a5367857e None None] MFA Rules not processed for user `19c901ae31584d32abf1e632750c8236`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:41.807522 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4a04d55e-59c8-4681-974e-f47a5367857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:41.876113 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1395/2821] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:41.887264 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76675d2c-2d77-4191-baec-9e38271e8746 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:41.888979 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-76675d2c-2d77-4191-baec-9e38271e8746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:41.947443 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76675d2c-2d77-4191-baec-9e38271e8746 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:41.951248 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e415bd-3276-4adf-8184-bdb129aecc17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:41.951884 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e415bd-3276-4adf-8184-bdb129aecc17 service cinder] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:41.952162 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e415bd-3276-4adf-8184-bdb129aecc17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:41.952436 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e415bd-3276-4adf-8184-bdb129aecc17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:41.990521 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:42.008761 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e415bd-3276-4adf-8184-bdb129aecc17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:42.010182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e415bd-3276-4adf-8184-bdb129aecc17 service cinder] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:42.019156 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1427/2822] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:46.975774 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d55e-59c8-4681-974e-f47a5367857e None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:46.978376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-4a04d55e-59c8-4681-974e-f47a5367857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:46.990268 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d55e-59c8-4681-974e-f47a5367857e None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:46.994542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15ef72-35ee-4897-8e64-738dcd6ec28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:46.995146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15ef72-35ee-4897-8e64-738dcd6ec28a service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:46.995422 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15ef72-35ee-4897-8e64-738dcd6ec28a service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:46.995693 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15ef72-35ee-4897-8e64-738dcd6ec28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:47.004771 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15ef72-35ee-4897-8e64-738dcd6ec28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:47.006189 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15ef72-35ee-4897-8e64-738dcd6ec28a service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:47.016347 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1396/2823] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:52.042658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=10 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:52.924524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e415bd-3276-4adf-8184-bdb129aecc17 service cinder] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:52.986082 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e415bd-3276-4adf-8184-bdb129aecc17 service cinder] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:52.990604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:52.991228 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:52.991505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:52.992318 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] PATH_INFO: `/v3/users/0116536bd021431dbeda3b50a8f868a6` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:52.993641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0116536bd021431dbeda3b50a8f868a6)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:52.995588 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:53.176358 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0116536bd021431dbeda3b50a8f868a6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:53.177023 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0116536bd021431dbeda3b50a8f868a6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:53.185004 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0116536bd021431dbeda3b50a8f868a6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:53.196823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0116536bd021431dbeda3b50a8f868a6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:53.270787 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0116536bd021431dbeda3b50a8f868a6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:53.277219 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1428/2824] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:36:52 2022] DELETE /identity/v3/users/0116536bd021431dbeda3b50a8f868a6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:53.282765 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fb423-f95e-485d-9765-816b5ea9f541 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:53.283245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fb423-f95e-485d-9765-816b5ea9f541 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:53.283348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fb423-f95e-485d-9765-816b5ea9f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:53.302697 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9b1fb423-f95e-485d-9765-816b5ea9f541 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:53.303898 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9b1fb423-f95e-485d-9765-816b5ea9f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:53.363119 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1397/2825] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:53.373342 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:53.374779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:53.431524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840d3b5-d170-4835-9668-124dcb56c38e admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:53.435059 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45700edd-ed7d-4ba6-b3cb-76671d3f2541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:53.435662 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700edd-ed7d-4ba6-b3cb-76671d3f2541 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:53.435939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700edd-ed7d-4ba6-b3cb-76671d3f2541 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:53.436212 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700edd-ed7d-4ba6-b3cb-76671d3f2541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:53.445078 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45700edd-ed7d-4ba6-b3cb-76671d3f2541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:53.446603 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45700edd-ed7d-4ba6-b3cb-76671d3f2541 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:53.456209 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1429/2826] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:53.873791 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fb423-f95e-485d-9765-816b5ea9f541 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:53.875341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9b1fb423-f95e-485d-9765-816b5ea9f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:53.888845 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fb423-f95e-485d-9765-816b5ea9f541 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:53.893703 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:53.894488 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:53.894770 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:53.895046 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] PATH_INFO: `/v3/projects/097573d014fb4448b11ec6635d36bb3c` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:53.897532 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097573d014fb4448b11ec6635d36bb3c)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:53.903284 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:54.003235 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097573d014fb4448b11ec6635d36bb3c', 'request_id': 'req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:54.009221 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097573d014fb4448b11ec6635d36bb3c', 'request_id': 'req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:54.011685 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:54.105187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097573d014fb4448b11ec6635d36bb3c', 'request_id': 'req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:54.115887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] The token cache is being invalidate because project 097573d014fb4448b11ec6635d36bb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:36:54.116176 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:54.117611 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:54.118899 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1398/2827] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:36:53 2022] DELETE /identity/v3/projects/097573d014fb4448b11ec6635d36bb3c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:54.123187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45700edd-ed7d-4ba6-b3cb-76671d3f2541 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:54.132874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45700edd-ed7d-4ba6-b3cb-76671d3f2541 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:54.151160 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:54.190650 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:54.191270 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:54.191552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:54.191823 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] PATH_INFO: `/v3/users/19c901ae31584d32abf1e632750c8236` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:54.192982 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c901ae31584d32abf1e632750c8236)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:54.194940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:54.388161 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c901ae31584d32abf1e632750c8236'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:54.388858 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c901ae31584d32abf1e632750c8236'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:54.395859 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c901ae31584d32abf1e632750c8236'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:54.408418 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c901ae31584d32abf1e632750c8236'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:54.482737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-e610957e-ed30-4a97-bbea-e1ae7e16e9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c901ae31584d32abf1e632750c8236'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:54.489037 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1430/2828] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:36:54 2022] DELETE /identity/v3/users/19c901ae31584d32abf1e632750c8236 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:54.892910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:54.892910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:54.907219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbde36-f192-4ce1-abbd-13f45ad6f7a4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:54.965222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:54.965855 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:54.966130 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:54.966435 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] PATH_INFO: `/v3/projects/7cd6a7e8adba4b4eb1900dc3d88fe86a` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:54.967566 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd6a7e8adba4b4eb1900dc3d88fe86a)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:54.969462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:55.071297 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd6a7e8adba4b4eb1900dc3d88fe86a', 'request_id': 'req-0379e05f-100d-442a-b4de-f468b82a1882'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:55.077232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd6a7e8adba4b4eb1900dc3d88fe86a', 'request_id': 'req-0379e05f-100d-442a-b4de-f468b82a1882'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:55.139683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd6a7e8adba4b4eb1900dc3d88fe86a', 'request_id': 'req-0379e05f-100d-442a-b4de-f468b82a1882'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:55.151318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] The token cache is being invalidate because project 7cd6a7e8adba4b4eb1900dc3d88fe86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:36:55.151591 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:55.152158 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-0379e05f-100d-442a-b4de-f468b82a1882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:55.153638 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1399/2829] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:36:54 2022] DELETE /identity/v3/projects/7cd6a7e8adba4b4eb1900dc3d88fe86a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:55.161494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4300b9-1ad3-46f2-9d1f-e96cb85b7e5b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:55.161779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4300b9-1ad3-46f2-9d1f-e96cb85b7e5b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:55.162053 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4300b9-1ad3-46f2-9d1f-e96cb85b7e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:55.182997 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-ac4300b9-1ad3-46f2-9d1f-e96cb85b7e5b None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:55.184190 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ac4300b9-1ad3-46f2-9d1f-e96cb85b7e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:55.242674 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1431/2830] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:55.250694 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c512683-a395-4b8a-8cfc-e07c4edc4b2e None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:55.250982 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c512683-a395-4b8a-8cfc-e07c4edc4b2e None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:55.251259 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c512683-a395-4b8a-8cfc-e07c4edc4b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:55.270978 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-2c512683-a395-4b8a-8cfc-e07c4edc4b2e None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:55.272167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2c512683-a395-4b8a-8cfc-e07c4edc4b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:55.280973 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1400/2831] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:55.285230 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4300b9-1ad3-46f2-9d1f-e96cb85b7e5b None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:55.295972 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4300b9-1ad3-46f2-9d1f-e96cb85b7e5b None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:55.300552 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c67df-c708-4b94-8778-4fd4b7f36393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:55.301271 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c67df-c708-4b94-8778-4fd4b7f36393 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:55.301544 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c67df-c708-4b94-8778-4fd4b7f36393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:55.301817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c67df-c708-4b94-8778-4fd4b7f36393 admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:55.302699 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c67df-c708-4b94-8778-4fd4b7f36393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:36:55.303006 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c67df-c708-4b94-8778-4fd4b7f36393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:55.304610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c67df-c708-4b94-8778-4fd4b7f36393 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:55.316438 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1432/2832] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:36:55.320855 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c512683-a395-4b8a-8cfc-e07c4edc4b2e None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:55.331706 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c512683-a395-4b8a-8cfc-e07c4edc4b2e None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:55.338641 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0581426-611a-41c4-82be-d18cb1b2b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:55.339272 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0581426-611a-41c4-82be-d18cb1b2b890 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:55.339547 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0581426-611a-41c4-82be-d18cb1b2b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:55.339821 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0581426-611a-41c4-82be-d18cb1b2b890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:55.340503 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0581426-611a-41c4-82be-d18cb1b2b890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:55.342479 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0581426-611a-41c4-82be-d18cb1b2b890 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:55.428177 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1401/2833] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:36:55 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:36:55.431998 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c67df-c708-4b94-8778-4fd4b7f36393 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:55.442574 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c67df-c708-4b94-8778-4fd4b7f36393 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:55.470234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:55.502557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfdda9-25e3-4b15-ba5a-6a5409ec6bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:55.503173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfdda9-25e3-4b15-ba5a-6a5409ec6bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:55.503685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfdda9-25e3-4b15-ba5a-6a5409ec6bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:55.503967 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfdda9-25e3-4b15-ba5a-6a5409ec6bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:55.504644 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfdda9-25e3-4b15-ba5a-6a5409ec6bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:55.506581 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfdda9-25e3-4b15-ba5a-6a5409ec6bc2 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:55.602554 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1433/2834] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:36:55 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:36:55.606610 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0581426-611a-41c4-82be-d18cb1b2b890 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:55.617034 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0581426-611a-41c4-82be-d18cb1b2b890 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:55.621887 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3c59e-1e16-411f-ad9f-aeab567813f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:55.622517 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c59e-1e16-411f-ad9f-aeab567813f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:55.622814 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c59e-1e16-411f-ad9f-aeab567813f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:55.623073 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c59e-1e16-411f-ad9f-aeab567813f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:55.623759 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3c59e-1e16-411f-ad9f-aeab567813f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:55.625415 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3c59e-1e16-411f-ad9f-aeab567813f4 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:55.636222 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1402/2835] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:55.640330 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfdda9-25e3-4b15-ba5a-6a5409ec6bc2 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:55.651326 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfdda9-25e3-4b15-ba5a-6a5409ec6bc2 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:55.656020 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f1102-70e0-4651-bc44-e07fd455ece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:55.656614 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f1102-70e0-4651-bc44-e07fd455ece4 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:55.656892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f1102-70e0-4651-bc44-e07fd455ece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:55.657163 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f1102-70e0-4651-bc44-e07fd455ece4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:55.657853 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f1102-70e0-4651-bc44-e07fd455ece4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:55.659455 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f1102-70e0-4651-bc44-e07fd455ece4 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:55.669279 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1434/2836] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:55.673154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3c59e-1e16-411f-ad9f-aeab567813f4 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:55.683569 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3c59e-1e16-411f-ad9f-aeab567813f4 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:55.688121 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91978a8-43cf-4b77-b4c4-e71caa79e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:55.688763 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91978a8-43cf-4b77-b4c4-e71caa79e6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:55.689040 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91978a8-43cf-4b77-b4c4-e71caa79e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:55.689316 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91978a8-43cf-4b77-b4c4-e71caa79e6a3 admin admin] PATH_INFO: `/v3/projects/70fa2a83b28d4b1cb9f02e7a4e9c988e/users/674a1ee338e84480867c402e6405084e/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:55.704170 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91978a8-43cf-4b77-b4c4-e71caa79e6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fa2a83b28d4b1cb9f02e7a4e9c988e, user_id=674a1ee338e84480867c402e6405084e, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:55.706847 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91978a8-43cf-4b77-b4c4-e71caa79e6a3 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:55.774544 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1403/2837] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:36:55 2022] PUT /identity/v3/projects/70fa2a83b28d4b1cb9f02e7a4e9c988e/users/674a1ee338e84480867c402e6405084e/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:36:55.785625 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d962c-6a94-4688-8344-457a2aff8b32 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:55.785909 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d962c-6a94-4688-8344-457a2aff8b32 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:55.786181 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d962c-6a94-4688-8344-457a2aff8b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:55.814120 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-e03d962c-6a94-4688-8344-457a2aff8b32 None None] MFA Rules not processed for user `674a1ee338e84480867c402e6405084e`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:55.815507 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-e03d962c-6a94-4688-8344-457a2aff8b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:55.879106 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1435/2838] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:55.890606 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91978a8-43cf-4b77-b4c4-e71caa79e6a3 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:55.892291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c91978a8-43cf-4b77-b4c4-e71caa79e6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:55.906755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:55.951659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91978a8-43cf-4b77-b4c4-e71caa79e6a3 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:55.955293 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb3892-8f71-4d0c-ba5c-e0dbfaa9a710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:55.955907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb3892-8f71-4d0c-ba5c-e0dbfaa9a710 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:55.956188 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb3892-8f71-4d0c-ba5c-e0dbfaa9a710 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:55.956464 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb3892-8f71-4d0c-ba5c-e0dbfaa9a710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:55.965407 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb3892-8f71-4d0c-ba5c-e0dbfaa9a710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:55.966919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb3892-8f71-4d0c-ba5c-e0dbfaa9a710 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:55.975744 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1404/2839] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:55.995363 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d962c-6a94-4688-8344-457a2aff8b32 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:56.058827 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d962c-6a94-4688-8344-457a2aff8b32 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:56.063303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:56.063922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:56.064193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:56.064461 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] PATH_INFO: `/v3/users/674a1ee338e84480867c402e6405084e` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:56.065604 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] RBAC: Authorizing `identity:delete_user(user_id=674a1ee338e84480867c402e6405084e)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:56.067510 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:56.204594 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:56.210226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674a1ee338e84480867c402e6405084e'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:56.211303 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674a1ee338e84480867c402e6405084e'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:56.217927 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674a1ee338e84480867c402e6405084e'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:56.230089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674a1ee338e84480867c402e6405084e'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:56.306420 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674a1ee338e84480867c402e6405084e'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:56.312456 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1436/2840] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:36:55 2022] DELETE /identity/v3/users/674a1ee338e84480867c402e6405084e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:56.316900 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0a30c-b2d3-4a0a-8076-ce6c9df5e64d None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:56.317190 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0a30c-b2d3-4a0a-8076-ce6c9df5e64d None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:56.317492 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0a30c-b2d3-4a0a-8076-ce6c9df5e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:56.336948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-9fe0a30c-b2d3-4a0a-8076-ce6c9df5e64d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:56.338146 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9fe0a30c-b2d3-4a0a-8076-ce6c9df5e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:56.399055 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1405/2841] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:56.409071 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:56.410516 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:56.469659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eec98-2c9b-4541-8664-e06f2268067f admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:56.470102 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a548c-ebf1-4a02-9c6a-52d21b83c113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:56.470737 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a548c-ebf1-4a02-9c6a-52d21b83c113 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:56.471013 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a548c-ebf1-4a02-9c6a-52d21b83c113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:56.471278 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a548c-ebf1-4a02-9c6a-52d21b83c113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:56.480832 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a548c-ebf1-4a02-9c6a-52d21b83c113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:56.482251 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a548c-ebf1-4a02-9c6a-52d21b83c113 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:56.492663 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1437/2842] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:36:56.901953 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0a30c-b2d3-4a0a-8076-ce6c9df5e64d None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:56.903443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-9fe0a30c-b2d3-4a0a-8076-ce6c9df5e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:56.915463 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0a30c-b2d3-4a0a-8076-ce6c9df5e64d None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:56.920596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:56.921319 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:56.921598 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:56.921871 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] PATH_INFO: `/v3/projects/70fa2a83b28d4b1cb9f02e7a4e9c988e` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:56.923059 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fa2a83b28d4b1cb9f02e7a4e9c988e)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:56.925003 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:57.020348 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fa2a83b28d4b1cb9f02e7a4e9c988e', 'request_id': 'req-cbb23d85-47a6-410d-8534-1dcfce66f003'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:57.027232 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fa2a83b28d4b1cb9f02e7a4e9c988e', 'request_id': 'req-cbb23d85-47a6-410d-8534-1dcfce66f003'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:57.099425 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fa2a83b28d4b1cb9f02e7a4e9c988e', 'request_id': 'req-cbb23d85-47a6-410d-8534-1dcfce66f003'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:57.110157 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] The token cache is being invalidate because project 70fa2a83b28d4b1cb9f02e7a4e9c988e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:36:57.110476 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:57.111093 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-cbb23d85-47a6-410d-8534-1dcfce66f003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:36:57.112583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1406/2843] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:36:56 2022] DELETE /identity/v3/projects/70fa2a83b28d4b1cb9f02e7a4e9c988e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:57.117871 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e4d2a-c2de-4237-9e4a-9ec5c782b2bb None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:57.118149 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e4d2a-c2de-4237-9e4a-9ec5c782b2bb None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:57.118469 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e4d2a-c2de-4237-9e4a-9ec5c782b2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:57.138155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-355e4d2a-c2de-4237-9e4a-9ec5c782b2bb None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:57.139363 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-355e4d2a-c2de-4237-9e4a-9ec5c782b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:57.198465 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1438/2844] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:57.207445 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882075d-8796-4203-b420-472d01be0b1c None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:57.207732 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882075d-8796-4203-b420-472d01be0b1c None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:57.208012 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882075d-8796-4203-b420-472d01be0b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:57.228116 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c882075d-8796-4203-b420-472d01be0b1c None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:57.229302 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c882075d-8796-4203-b420-472d01be0b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:57.237201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1407/2845] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:57.241366 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e4d2a-c2de-4237-9e4a-9ec5c782b2bb None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:57.251187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e4d2a-c2de-4237-9e4a-9ec5c782b2bb None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:57.255687 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d3440-520b-4402-81d6-0988bb133b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:57.256281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d3440-520b-4402-81d6-0988bb133b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:57.256551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d3440-520b-4402-81d6-0988bb133b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:57.256817 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d3440-520b-4402-81d6-0988bb133b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:57.258118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d3440-520b-4402-81d6-0988bb133b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80698) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:36:57.258414 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d3440-520b-4402-81d6-0988bb133b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:57.259978 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d3440-520b-4402-81d6-0988bb133b7c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:57.271167 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1439/2846] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:36:57.276511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882075d-8796-4203-b420-472d01be0b1c None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:57.285748 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882075d-8796-4203-b420-472d01be0b1c None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:57.291219 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81315df8-ab7d-4aa1-a6fa-a48859ba1244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:57.291877 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81315df8-ab7d-4aa1-a6fa-a48859ba1244 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:57.292156 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81315df8-ab7d-4aa1-a6fa-a48859ba1244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:57.292429 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81315df8-ab7d-4aa1-a6fa-a48859ba1244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:57.293126 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81315df8-ab7d-4aa1-a6fa-a48859ba1244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:57.295092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81315df8-ab7d-4aa1-a6fa-a48859ba1244 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:57.392257 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1408/2847] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:36:57 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:57.396371 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d3440-520b-4402-81d6-0988bb133b7c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:57.406494 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d3440-520b-4402-81d6-0988bb133b7c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:57.450250 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:57.463068 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaf862-d768-4efe-8801-4dd12a6d7795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:57.463676 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaf862-d768-4efe-8801-4dd12a6d7795 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:57.464061 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaf862-d768-4efe-8801-4dd12a6d7795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:57.464337 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaf862-d768-4efe-8801-4dd12a6d7795 admin admin] PATH_INFO: `/v3/users` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:57.464992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaf862-d768-4efe-8801-4dd12a6d7795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:57.467005 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaf862-d768-4efe-8801-4dd12a6d7795 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:57.568599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1440/2848] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:36:57 2022] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:36:57.573510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81315df8-ab7d-4aa1-a6fa-a48859ba1244 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:57.583833 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81315df8-ab7d-4aa1-a6fa-a48859ba1244 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:57.589381 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb601294-93f8-46dd-82ff-73eb489febf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:57.589580 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb601294-93f8-46dd-82ff-73eb489febf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:57.589859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb601294-93f8-46dd-82ff-73eb489febf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:57.590160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb601294-93f8-46dd-82ff-73eb489febf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:57.590871 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb601294-93f8-46dd-82ff-73eb489febf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:57.592455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb601294-93f8-46dd-82ff-73eb489febf8 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:57.594524 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:57.603060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1409/2849] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:57.607012 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaf862-d768-4efe-8801-4dd12a6d7795 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:57.616693 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaf862-d768-4efe-8801-4dd12a6d7795 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:57.621760 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de453a-2961-4dec-b724-268ac085db4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:57.622372 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de453a-2961-4dec-b724-268ac085db4a admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:57.622649 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de453a-2961-4dec-b724-268ac085db4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:57.622917 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de453a-2961-4dec-b724-268ac085db4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:57.623592 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de453a-2961-4dec-b724-268ac085db4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:57.625148 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de453a-2961-4dec-b724-268ac085db4a admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:57.636557 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1441/2850] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:36:57.640089 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb601294-93f8-46dd-82ff-73eb489febf8 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:57.650563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb601294-93f8-46dd-82ff-73eb489febf8 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:57.655267 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0782949-6690-48c6-8f4a-e6d9ef02b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:57.655912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0782949-6690-48c6-8f4a-e6d9ef02b52c admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:57.656187 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0782949-6690-48c6-8f4a-e6d9ef02b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:57.656460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0782949-6690-48c6-8f4a-e6d9ef02b52c admin admin] PATH_INFO: `/v3/projects/f16e3183e72243169b4ed9d0e7b3c806/users/a761b9092ffa45c4b56f8011f972ffaf/roles/135a36507984447394cee2c2924414bb` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:57.671989 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0782949-6690-48c6-8f4a-e6d9ef02b52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16e3183e72243169b4ed9d0e7b3c806, user_id=a761b9092ffa45c4b56f8011f972ffaf, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:57.674648 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0782949-6690-48c6-8f4a-e6d9ef02b52c admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:57.750919 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1410/2851] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:36:57 2022] PUT /identity/v3/projects/f16e3183e72243169b4ed9d0e7b3c806/users/a761b9092ffa45c4b56f8011f972ffaf/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:36:57.761976 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00216422-11cd-4c0e-9d4f-fb3fe26bd58b None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:57.762264 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00216422-11cd-4c0e-9d4f-fb3fe26bd58b None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:57.762570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00216422-11cd-4c0e-9d4f-fb3fe26bd58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:57.789658 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-00216422-11cd-4c0e-9d4f-fb3fe26bd58b None None] MFA Rules not processed for user `a761b9092ffa45c4b56f8011f972ffaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:36:57.790882 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-00216422-11cd-4c0e-9d4f-fb3fe26bd58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:57.853772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1442/2852] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:36:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:36:57.864787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0782949-6690-48c6-8f4a-e6d9ef02b52c admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:36:57.866485 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f0782949-6690-48c6-8f4a-e6d9ef02b52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:36:57.923884 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0782949-6690-48c6-8f4a-e6d9ef02b52c admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:36:57.927531 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993ddb1-2628-4506-a5b5-c379797f5394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600993aa29bc452f8658ed8cb426b470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:36:57.928135 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993ddb1-2628-4506-a5b5-c379797f5394 service cinder] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:36:57.928409 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993ddb1-2628-4506-a5b5-c379797f5394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:36:57.928679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993ddb1-2628-4506-a5b5-c379797f5394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:36:57.937820 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993ddb1-2628-4506-a5b5-c379797f5394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:36:57.939258 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993ddb1-2628-4506-a5b5-c379797f5394 service cinder] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:36:57.948995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1411/2853] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:36:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:37:05.547203 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ef992-1fd3-4bd1-9b1d-ad52ff6217d6 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:05.547686 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ef992-1fd3-4bd1-9b1d-ad52ff6217d6 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:05.547787 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ef992-1fd3-4bd1-9b1d-ad52ff6217d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:05.567039 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-d19ef992-1fd3-4bd1-9b1d-ad52ff6217d6 None None] MFA Rules not processed for user `5ffe04946139486bb4b976cb0503e0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:37:05.568258 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d19ef992-1fd3-4bd1-9b1d-ad52ff6217d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:05.622183 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1443/2854] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:37:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:37:05.937619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993ddb1-2628-4506-a5b5-c379797f5394 service cinder] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:05.940391 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-b993ddb1-2628-4506-a5b5-c379797f5394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:05.994658 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993ddb1-2628-4506-a5b5-c379797f5394 service cinder] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:05.998516 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd5106-4472-4e87-8e51-4ef54d483974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:05.999133 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd5106-4472-4e87-8e51-4ef54d483974 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:05.999414 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd5106-4472-4e87-8e51-4ef54d483974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:05.999688 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd5106-4472-4e87-8e51-4ef54d483974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:06.001553 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f9cd5106-4472-4e87-8e51-4ef54d483974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:06.013909 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd5106-4472-4e87-8e51-4ef54d483974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:06.015329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd5106-4472-4e87-8e51-4ef54d483974 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:06.024291 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1412/2855] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:37:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:37:06.724734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ef992-1fd3-4bd1-9b1d-ad52ff6217d6 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:06.727045 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-d19ef992-1fd3-4bd1-9b1d-ad52ff6217d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:06.795236 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:06.801199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ef992-1fd3-4bd1-9b1d-ad52ff6217d6 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:06.807146 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57726f35-b7b9-4642-a04d-1b896d92269d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:06.807755 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57726f35-b7b9-4642-a04d-1b896d92269d service placement] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:06.808032 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57726f35-b7b9-4642-a04d-1b896d92269d service placement] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:06.808332 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57726f35-b7b9-4642-a04d-1b896d92269d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:06.810099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-57726f35-b7b9-4642-a04d-1b896d92269d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:06.821743 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57726f35-b7b9-4642-a04d-1b896d92269d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:06.823453 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57726f35-b7b9-4642-a04d-1b896d92269d service placement] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:06.833901 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1444/2856] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:37:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:37:16.019859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:16.950582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=5 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:22.001287 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd5106-4472-4e87-8e51-4ef54d483974 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:22.004853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f9cd5106-4472-4e87-8e51-4ef54d483974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:22.085286 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd5106-4472-4e87-8e51-4ef54d483974 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:22.091110 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1f6c2-ac41-4f09-be39-e1c722da33a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:22.091725 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1f6c2-ac41-4f09-be39-e1c722da33a6 service nova] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:22.092501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1f6c2-ac41-4f09-be39-e1c722da33a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:22.092501 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1f6c2-ac41-4f09-be39-e1c722da33a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:22.094344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-f2b1f6c2-ac41-4f09-be39-e1c722da33a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:22.108306 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1f6c2-ac41-4f09-be39-e1c722da33a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:22.110535 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1f6c2-ac41-4f09-be39-e1c722da33a6 service nova] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:22.122443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1413/2857] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:37:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:37:26.526199 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57726f35-b7b9-4642-a04d-1b896d92269d service placement] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:26.539357 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57726f35-b7b9-4642-a04d-1b896d92269d service placement] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:26.544991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb9799-9a63-4ec7-9af4-1e6970d3bd1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f7331502484928ba7f8a4b403bdddd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:26.545600 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9799-9a63-4ec7-9af4-1e6970d3bd1e service nova] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:26.545879 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9799-9a63-4ec7-9af4-1e6970d3bd1e service nova] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:26.546152 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9799-9a63-4ec7-9af4-1e6970d3bd1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:26.548044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-ffeb9799-9a63-4ec7-9af4-1e6970d3bd1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:26.560897 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb9799-9a63-4ec7-9af4-1e6970d3bd1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:26.562508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb9799-9a63-4ec7-9af4-1e6970d3bd1e service nova] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:26.573622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1445/2858] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:37:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:37:32.116907 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=34 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:36.444583 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1f6c2-ac41-4f09-be39-e1c722da33a6 service nova] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:36.508880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1f6c2-ac41-4f09-be39-e1c722da33a6 service nova] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:36.514460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:36.515165 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:36.515440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:36.515710 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] PATH_INFO: `/v3/users/a761b9092ffa45c4b56f8011f972ffaf` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:36.516873 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a761b9092ffa45c4b56f8011f972ffaf)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:36.518827 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:36.568678 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=6 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:36.720014 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a761b9092ffa45c4b56f8011f972ffaf'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:37:36.720787 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a761b9092ffa45c4b56f8011f972ffaf'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:37:36.728883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a761b9092ffa45c4b56f8011f972ffaf'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:37:36.729657 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a761b9092ffa45c4b56f8011f972ffaf'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:37:36.836334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a761b9092ffa45c4b56f8011f972ffaf'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:37:36.854873 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1414/2859] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:37:36 2022] DELETE /identity/v3/users/a761b9092ffa45c4b56f8011f972ffaf => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:37:36.859481 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4cf5a-f4ee-4204-b2d6-3c019cc8589d None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:36.859787 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4cf5a-f4ee-4204-b2d6-3c019cc8589d None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:36.860044 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4cf5a-f4ee-4204-b2d6-3c019cc8589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:36.880660 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-64c4cf5a-f4ee-4204-b2d6-3c019cc8589d None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:37:36.881862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-64c4cf5a-f4ee-4204-b2d6-3c019cc8589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:36.942083 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1446/2860] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:37:36.951783 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:36.953216 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:37.010428 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce5c81-9bc5-4d91-a524-3c4995f27000 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:37.014068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aa84d-3203-4dec-bdc1-43e3afdf821a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:37.014712 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aa84d-3203-4dec-bdc1-43e3afdf821a service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:37.014991 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aa84d-3203-4dec-bdc1-43e3afdf821a service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:37.015266 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aa84d-3203-4dec-bdc1-43e3afdf821a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:37.024179 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aa84d-3203-4dec-bdc1-43e3afdf821a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:37.026436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aa84d-3203-4dec-bdc1-43e3afdf821a service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:37.035865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1415/2861] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:37:37.468731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4cf5a-f4ee-4204-b2d6-3c019cc8589d None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:37.469182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-64c4cf5a-f4ee-4204-b2d6-3c019cc8589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:37.481677 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4cf5a-f4ee-4204-b2d6-3c019cc8589d None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:37.487943 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:37.488593 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:37.488867 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:37.489135 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] PATH_INFO: `/v3/projects/f16e3183e72243169b4ed9d0e7b3c806` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:37.490296 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16e3183e72243169b4ed9d0e7b3c806)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:37.492298 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:37.625218 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16e3183e72243169b4ed9d0e7b3c806', 'request_id': 'req-d17f46c6-5cfc-4773-a57e-bcbc292e2992'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:37:37.631700 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16e3183e72243169b4ed9d0e7b3c806', 'request_id': 'req-d17f46c6-5cfc-4773-a57e-bcbc292e2992'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:37:37.704668 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16e3183e72243169b4ed9d0e7b3c806', 'request_id': 'req-d17f46c6-5cfc-4773-a57e-bcbc292e2992'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:37:37.721177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] The token cache is being invalidate because project f16e3183e72243169b4ed9d0e7b3c806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:37:37.721177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:37:37.721177 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-d17f46c6-5cfc-4773-a57e-bcbc292e2992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:37:37.722325 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1447/2862] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:37:37 2022] DELETE /identity/v3/projects/f16e3183e72243169b4ed9d0e7b3c806 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:37:37.728161 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589fc5f-9253-4d51-a9e5-d74dbf3ca0ca None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:37.728902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589fc5f-9253-4d51-a9e5-d74dbf3ca0ca None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:37.728902 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589fc5f-9253-4d51-a9e5-d74dbf3ca0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:37.749466 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-8589fc5f-9253-4d51-a9e5-d74dbf3ca0ca None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:37:37.750769 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8589fc5f-9253-4d51-a9e5-d74dbf3ca0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:37.771523 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:37.821915 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1416/2863] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:37:37.835736 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8c3ec-51b6-4cd4-ae67-551a952df362 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:37.840143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8c3ec-51b6-4cd4-ae67-551a952df362 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:37.840143 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8c3ec-51b6-4cd4-ae67-551a952df362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:37.858188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-baf8c3ec-51b6-4cd4-ae67-551a952df362 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:37:37.859417 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-baf8c3ec-51b6-4cd4-ae67-551a952df362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:37.869771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1448/2864] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:37:37.874201 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589fc5f-9253-4d51-a9e5-d74dbf3ca0ca None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:37.883995 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589fc5f-9253-4d51-a9e5-d74dbf3ca0ca None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:37.890341 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820e30-3a55-4547-99f6-79e66df1edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:37.891565 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820e30-3a55-4547-99f6-79e66df1edba admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:37.891889 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820e30-3a55-4547-99f6-79e66df1edba admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:37.892164 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820e30-3a55-4547-99f6-79e66df1edba admin admin] PATH_INFO: `/v3/domains` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:37.892859 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14820e30-3a55-4547-99f6-79e66df1edba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:37:37.893163 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14820e30-3a55-4547-99f6-79e66df1edba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:37.894781 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14820e30-3a55-4547-99f6-79e66df1edba admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:37.911092 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1417/2865] 10.222.0.46 () {58 vars in 1153 bytes} [Thu Aug 4 05:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:37:37.915553 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8c3ec-51b6-4cd4-ae67-551a952df362 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:37.925340 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8c3ec-51b6-4cd4-ae67-551a952df362 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:37.930118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccc7ed-f67a-41ed-af36-150dffa4383c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:37.930766 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccc7ed-f67a-41ed-af36-150dffa4383c admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:37.931043 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccc7ed-f67a-41ed-af36-150dffa4383c admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:37.931314 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccc7ed-f67a-41ed-af36-150dffa4383c admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:37.932626 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccc7ed-f67a-41ed-af36-150dffa4383c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:37.934558 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccc7ed-f67a-41ed-af36-150dffa4383c admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:38.020669 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1449/2866] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:37:37 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:37:38.025165 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820e30-3a55-4547-99f6-79e66df1edba admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:38.035740 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820e30-3a55-4547-99f6-79e66df1edba admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:38.096117 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a2923-4629-41bc-b5dc-a1a63a801217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:38.096724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a2923-4629-41bc-b5dc-a1a63a801217 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:38.097009 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a2923-4629-41bc-b5dc-a1a63a801217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:38.097283 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a2923-4629-41bc-b5dc-a1a63a801217 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:38.097938 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a2923-4629-41bc-b5dc-a1a63a801217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:38.099883 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a2923-4629-41bc-b5dc-a1a63a801217 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:38.231752 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1418/2867] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:37:38 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:37:38.236036 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccc7ed-f67a-41ed-af36-150dffa4383c admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:38.246667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccc7ed-f67a-41ed-af36-150dffa4383c admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:38.251243 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82090350-0210-4a5b-ac53-35325643cc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:38.251872 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82090350-0210-4a5b-ac53-35325643cc41 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:38.252147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82090350-0210-4a5b-ac53-35325643cc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:38.252417 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82090350-0210-4a5b-ac53-35325643cc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:38.253127 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82090350-0210-4a5b-ac53-35325643cc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:38.254769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82090350-0210-4a5b-ac53-35325643cc41 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:38.265105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1450/2868] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:37:38.269106 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a2923-4629-41bc-b5dc-a1a63a801217 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:38.280208 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a2923-4629-41bc-b5dc-a1a63a801217 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:38.285068 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ad3f1-957d-47f5-8ecd-d02b86e9a443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:38.285680 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad3f1-957d-47f5-8ecd-d02b86e9a443 admin admin] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:38.285965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad3f1-957d-47f5-8ecd-d02b86e9a443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:38.286245 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad3f1-957d-47f5-8ecd-d02b86e9a443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:38.286975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ad3f1-957d-47f5-8ecd-d02b86e9a443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:38.288619 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ad3f1-957d-47f5-8ecd-d02b86e9a443 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:38.298631 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1419/2869] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:37:38.302771 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82090350-0210-4a5b-ac53-35325643cc41 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:38.312706 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82090350-0210-4a5b-ac53-35325643cc41 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:38.317277 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16599a-7e65-4e3b-b77f-e1a7cc3b3c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:38.317920 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16599a-7e65-4e3b-b77f-e1a7cc3b3c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:38.318196 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16599a-7e65-4e3b-b77f-e1a7cc3b3c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:38.318506 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16599a-7e65-4e3b-b77f-e1a7cc3b3c22 admin admin] PATH_INFO: `/v3/projects/49ee5ac3fb644e24973f40ede2c94de7/users/c8ff7be84ccd459cb7159bcffc1de249/roles/135a36507984447394cee2c2924414bb` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:38.333440 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16599a-7e65-4e3b-b77f-e1a7cc3b3c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ee5ac3fb644e24973f40ede2c94de7, user_id=c8ff7be84ccd459cb7159bcffc1de249, role_id=135a36507984447394cee2c2924414bb)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:38.336132 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16599a-7e65-4e3b-b77f-e1a7cc3b3c22 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:38.424874 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1451/2870] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:37:38 2022] PUT /identity/v3/projects/49ee5ac3fb644e24973f40ede2c94de7/users/c8ff7be84ccd459cb7159bcffc1de249/roles/135a36507984447394cee2c2924414bb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:37:38.429880 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501ffb3-f8d2-4c3f-8721-5375568e5b73 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:38.430167 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501ffb3-f8d2-4c3f-8721-5375568e5b73 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:38.430502 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501ffb3-f8d2-4c3f-8721-5375568e5b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:38.450801 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-c501ffb3-f8d2-4c3f-8721-5375568e5b73 None None] MFA Rules not processed for user `75b3532d53944d4789f9bd6bd6ab00cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:37:38.459661 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-c501ffb3-f8d2-4c3f-8721-5375568e5b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:38.511679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1420/2871] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:37:38.521458 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16599a-7e65-4e3b-b77f-e1a7cc3b3c22 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:38.523173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7f16599a-7e65-4e3b-b77f-e1a7cc3b3c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:38.547025 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:38.580085 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16599a-7e65-4e3b-b77f-e1a7cc3b3c22 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:38.583862 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14026c-3835-4517-b5fa-aa328baaed70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:38.584560 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14026c-3835-4517-b5fa-aa328baaed70 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:38.584838 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14026c-3835-4517-b5fa-aa328baaed70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:38.585103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14026c-3835-4517-b5fa-aa328baaed70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:38.594439 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14026c-3835-4517-b5fa-aa328baaed70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:38.598789 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14026c-3835-4517-b5fa-aa328baaed70 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:38.605114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1452/2872] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:37:43.471385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77f830-af0f-4721-acf5-d245ab36bb54 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:43.472264 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77f830-af0f-4721-acf5-d245ab36bb54 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:43.472542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77f830-af0f-4721-acf5-d245ab36bb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:43.509542 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-ce77f830-af0f-4721-acf5-d245ab36bb54 None None] MFA Rules not processed for user `c8ff7be84ccd459cb7159bcffc1de249`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:37:43.511019 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-ce77f830-af0f-4721-acf5-d245ab36bb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:43.533665 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:43.591996 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1421/2873] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:37:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:37:43.600060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14026c-3835-4517-b5fa-aa328baaed70 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:43.610987 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14026c-3835-4517-b5fa-aa328baaed70 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:43.616547 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717f8b-4efb-4202-9a27-e8d56c243d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:43.617174 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717f8b-4efb-4202-9a27-e8d56c243d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:43.617619 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717f8b-4efb-4202-9a27-e8d56c243d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:43.617898 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717f8b-4efb-4202-9a27-e8d56c243d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:43.618622 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717f8b-4efb-4202-9a27-e8d56c243d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:43.621347 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717f8b-4efb-4202-9a27-e8d56c243d63 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:43.777657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1453/2874] 10.222.0.46 () {60 vars in 1153 bytes} [Thu Aug 4 05:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:37:43.781708 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77f830-af0f-4721-acf5-d245ab36bb54 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:43.793231 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77f830-af0f-4721-acf5-d245ab36bb54 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:43.851317 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9252ef7-9126-4b8e-8e2b-5b156c851e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:43.852160 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9252ef7-9126-4b8e-8e2b-5b156c851e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:43.852511 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9252ef7-9126-4b8e-8e2b-5b156c851e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:43.852855 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9252ef7-9126-4b8e-8e2b-5b156c851e82 admin admin] PATH_INFO: `/v3/users` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:43.854174 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9252ef7-9126-4b8e-8e2b-5b156c851e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:43.856196 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9252ef7-9126-4b8e-8e2b-5b156c851e82 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:43.934197 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1422/2875] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Aug 4 05:37:43 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:37:43.938231 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717f8b-4efb-4202-9a27-e8d56c243d63 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:43.949092 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717f8b-4efb-4202-9a27-e8d56c243d63 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:43.953599 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c109d53-2f7d-41d0-ad01-0e66e7ba5646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:43.954193 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c109d53-2f7d-41d0-ad01-0e66e7ba5646 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:43.954508 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c109d53-2f7d-41d0-ad01-0e66e7ba5646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:43.954779 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c109d53-2f7d-41d0-ad01-0e66e7ba5646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:43.955466 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c109d53-2f7d-41d0-ad01-0e66e7ba5646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:43.957340 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c109d53-2f7d-41d0-ad01-0e66e7ba5646 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:43.972388 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1454/2876] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:37:43.973602 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9252ef7-9126-4b8e-8e2b-5b156c851e82 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:43.984538 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9252ef7-9126-4b8e-8e2b-5b156c851e82 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:43.989254 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa83db2-29df-4163-b986-fb517f5876a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:43.989913 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa83db2-29df-4163-b986-fb517f5876a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:43.990192 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa83db2-29df-4163-b986-fb517f5876a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:43.990496 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa83db2-29df-4163-b986-fb517f5876a5 admin admin] PATH_INFO: `/v3/projects/8b9d2c1e38b64e8383b2640e2004fed8/users/21788b45cb2b454a8145bc4281d4a66d/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:44.004832 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa83db2-29df-4163-b986-fb517f5876a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9d2c1e38b64e8383b2640e2004fed8, user_id=21788b45cb2b454a8145bc4281d4a66d, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:44.007516 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa83db2-29df-4163-b986-fb517f5876a5 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:44.115940 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1423/2877] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:37:43 2022] PUT /identity/v3/projects/8b9d2c1e38b64e8383b2640e2004fed8/users/21788b45cb2b454a8145bc4281d4a66d/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:37:44.119986 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c109d53-2f7d-41d0-ad01-0e66e7ba5646 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:44.129899 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c109d53-2f7d-41d0-ad01-0e66e7ba5646 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:44.187708 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583e20e-0c6f-45ff-aaac-242589f53078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:44.188248 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583e20e-0c6f-45ff-aaac-242589f53078 admin admin] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:44.188529 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583e20e-0c6f-45ff-aaac-242589f53078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:44.188805 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583e20e-0c6f-45ff-aaac-242589f53078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:44.189505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583e20e-0c6f-45ff-aaac-242589f53078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:44.191147 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583e20e-0c6f-45ff-aaac-242589f53078 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:44.202191 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1455/2878] 10.222.0.46 () {58 vars in 1122 bytes} [Thu Aug 4 05:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:37:44.206280 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa83db2-29df-4163-b986-fb517f5876a5 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:44.217841 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa83db2-29df-4163-b986-fb517f5876a5 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:44.222720 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862d750-2bdd-4d52-a263-c4d196bd0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:44.223404 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862d750-2bdd-4d52-a263-c4d196bd0e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:44.223687 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862d750-2bdd-4d52-a263-c4d196bd0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:44.223965 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862d750-2bdd-4d52-a263-c4d196bd0e2b admin admin] PATH_INFO: `/v3/projects/8b9d2c1e38b64e8383b2640e2004fed8/users/21788b45cb2b454a8145bc4281d4a66d/roles/137fc99a654a41f09c3203a6c50d3555` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:44.225968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862d750-2bdd-4d52-a263-c4d196bd0e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9d2c1e38b64e8383b2640e2004fed8, user_id=21788b45cb2b454a8145bc4281d4a66d, role_id=137fc99a654a41f09c3203a6c50d3555)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:44.228644 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862d750-2bdd-4d52-a263-c4d196bd0e2b admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:44.239498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1424/2879] 10.222.0.46 () {60 vars in 1483 bytes} [Thu Aug 4 05:37:44 2022] PUT /identity/v3/projects/8b9d2c1e38b64e8383b2640e2004fed8/users/21788b45cb2b454a8145bc4281d4a66d/roles/137fc99a654a41f09c3203a6c50d3555 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:37:49.816977 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852b995-87cc-4a38-8171-340909233545 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:49.817462 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852b995-87cc-4a38-8171-340909233545 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:49.817571 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852b995-87cc-4a38-8171-340909233545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:49.857084 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-b852b995-87cc-4a38-8171-340909233545 None None] MFA Rules not processed for user `21788b45cb2b454a8145bc4281d4a66d`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:37:49.858423 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-b852b995-87cc-4a38-8171-340909233545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:49.931105 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1456/2880] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:37:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:37:49.943368 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862d750-2bdd-4d52-a263-c4d196bd0e2b admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:49.945056 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-8862d750-2bdd-4d52-a263-c4d196bd0e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:50.029251 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862d750-2bdd-4d52-a263-c4d196bd0e2b admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:50.032793 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3e36-a784-4b8f-a6a8-4184cdbb0320 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc9a884f16149cda246ea9638621296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:50.033402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3e36-a784-4b8f-a6a8-4184cdbb0320 service glance] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:50.033683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3e36-a784-4b8f-a6a8-4184cdbb0320 service glance] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:50.033957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3e36-a784-4b8f-a6a8-4184cdbb0320 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:50.037999 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:50.090402 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae3e36-a784-4b8f-a6a8-4184cdbb0320 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:50.091930 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae3e36-a784-4b8f-a6a8-4184cdbb0320 service glance] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:50.101488 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1425/2881] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:37:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:37:50.321480 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5a948-9d95-4248-9556-c06cc1bb05f8 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:50.321770 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5a948-9d95-4248-9556-c06cc1bb05f8 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:50.322118 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5a948-9d95-4248-9556-c06cc1bb05f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:50.341094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-57c5a948-9d95-4248-9556-c06cc1bb05f8 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:37:50.342278 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-57c5a948-9d95-4248-9556-c06cc1bb05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:50.347624 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:50.404381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1457/2882] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:37:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:37:50.549683 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3e36-a784-4b8f-a6a8-4184cdbb0320 service glance] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:37:50.551134 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-19ae3e36-a784-4b8f-a6a8-4184cdbb0320 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:37:50.634331 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3e36-a784-4b8f-a6a8-4184cdbb0320 service glance] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:37:50.639281 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fed48-1bfc-4090-bcd8-d87f7181dd6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:37:50.639895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fed48-1bfc-4090-bcd8-d87f7181dd6f service swift] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:37:50.640175 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fed48-1bfc-4090-bcd8-d87f7181dd6f service swift] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:37:50.640448 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fed48-1bfc-4090-bcd8-d87f7181dd6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:37:50.648385 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fed48-1bfc-4090-bcd8-d87f7181dd6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:37:50.650796 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fed48-1bfc-4090-bcd8-d87f7181dd6f service swift] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:37:50.658789 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1426/2883] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:37:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:38:00.280950 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b8ae-f212-4a1d-acca-9afeca08b085 None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:38:00.281487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b8ae-f212-4a1d-acca-9afeca08b085 None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:38:00.281487 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b8ae-f212-4a1d-acca-9afeca08b085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:38:00.300226 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-7cc2b8ae-f212-4a1d-acca-9afeca08b085 None None] MFA Rules not processed for user `c8ff7be84ccd459cb7159bcffc1de249`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:38:00.301514 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-7cc2b8ae-f212-4a1d-acca-9afeca08b085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:38:00.309572 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1458/2884] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:38:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:38:00.655556 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=62 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:03.570223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d9278-4235-4a56-a33b-d4b9c38be5e5 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:38:03.570853 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d9278-4235-4a56-a33b-d4b9c38be5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:38:03.571050 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d9278-4235-4a56-a33b-d4b9c38be5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:38:03.591328 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-eb3d9278-4235-4a56-a33b-d4b9c38be5e5 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:38:03.592660 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-eb3d9278-4235-4a56-a33b-d4b9c38be5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:38:03.600344 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1427/2885] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Aug 4 05:38:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:38:03.613605 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2b8ae-f212-4a1d-acca-9afeca08b085 None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:38:03.626022 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2b8ae-f212-4a1d-acca-9afeca08b085 None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:38:03.631089 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60301a6-111f-4f76-8589-d3848a786d46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:38:03.631667 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60301a6-111f-4f76-8589-d3848a786d46 service swift] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:38:03.631944 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60301a6-111f-4f76-8589-d3848a786d46 service swift] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:38:03.632214 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60301a6-111f-4f76-8589-d3848a786d46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:38:03.641505 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60301a6-111f-4f76-8589-d3848a786d46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:38:03.643131 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60301a6-111f-4f76-8589-d3848a786d46 service swift] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:38:03.651566 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1459/2886] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:38:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:38:13.585387 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=3 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:13.647846 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=29 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:32.078673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d9278-4235-4a56-a33b-d4b9c38be5e5 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:38:32.080060 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-eb3d9278-4235-4a56-a33b-d4b9c38be5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:38:32.136181 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d9278-4235-4a56-a33b-d4b9c38be5e5 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:38:32.140079 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a17a-6343-48c8-ba97-5a5c5beba250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:38:32.140690 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a17a-6343-48c8-ba97-5a5c5beba250 service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:38:32.140968 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a17a-6343-48c8-ba97-5a5c5beba250 service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:38:32.141239 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a17a-6343-48c8-ba97-5a5c5beba250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:38:32.150389 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060a17a-6343-48c8-ba97-5a5c5beba250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:38:32.151834 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060a17a-6343-48c8-ba97-5a5c5beba250 service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:38:32.161304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1428/2887] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:38:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:38:42.157010 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=26 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:03.044551 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec05e3-9755-4e67-af23-63d74317111c None None] REQUEST_METHOD: `POST` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:39:03.045095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec05e3-9755-4e67-af23-63d74317111c None None] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:39:03.045095 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec05e3-9755-4e67-af23-63d74317111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:39:03.063992 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.auth.core [None req-3eec05e3-9755-4e67-af23-63d74317111c None None] MFA Rules not processed for user `5ffe04946139486bb4b976cb0503e0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80698) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:39:03.065188 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3eec05e3-9755-4e67-af23-63d74317111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:39:03.129390 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1460/2888] 10.222.0.46 () {58 vars in 958 bytes} [Thu Aug 4 05:39:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:39:03.448206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a17a-6343-48c8-ba97-5a5c5beba250 service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:39:03.457512 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a17a-6343-48c8-ba97-5a5c5beba250 service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:39:03.461080 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d06bf-b7c1-4ade-a8ca-a1f4f455eb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:39:03.461670 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d06bf-b7c1-4ade-a8ca-a1f4f455eb7d service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:39:03.461944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d06bf-b7c1-4ade-a8ca-a1f4f455eb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:39:03.462212 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d06bf-b7c1-4ade-a8ca-a1f4f455eb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:39:03.463972 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-655d06bf-b7c1-4ade-a8ca-a1f4f455eb7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:39:03.473462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d06bf-b7c1-4ade-a8ca-a1f4f455eb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:39:03.474934 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d06bf-b7c1-4ade-a8ca-a1f4f455eb7d service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:39:03.482817 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1429/2889] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:39:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:39:05.336172 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec05e3-9755-4e67-af23-63d74317111c None None] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:39:05.337591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3eec05e3-9755-4e67-af23-63d74317111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:39:05.409276 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec05e3-9755-4e67-af23-63d74317111c None None] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:39:05.414286 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401b7ea-22aa-40d8-b72f-455ec1f0da6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:39:05.414991 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401b7ea-22aa-40d8-b72f-455ec1f0da6e service placement] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:39:05.415268 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401b7ea-22aa-40d8-b72f-455ec1f0da6e service placement] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:39:05.415568 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401b7ea-22aa-40d8-b72f-455ec1f0da6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:39:05.417310 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-c401b7ea-22aa-40d8-b72f-455ec1f0da6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:39:05.429254 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401b7ea-22aa-40d8-b72f-455ec1f0da6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:39:05.430906 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401b7ea-22aa-40d8-b72f-455ec1f0da6e service placement] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:39:05.441281 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1461/2890] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:39:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:39:13.479217 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=6 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:15.436580 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=57 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:47.358413 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e4c8b-33d6-4040-b4b9-140c7cd6acd2 None None] REQUEST_METHOD: `POST` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:39:47.358914 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e4c8b-33d6-4040-b4b9-140c7cd6acd2 None None] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:39:47.359021 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e4c8b-33d6-4040-b4b9-140c7cd6acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:39:47.379462 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.auth.core [None req-cb3e4c8b-33d6-4040-b4b9-140c7cd6acd2 None None] MFA Rules not processed for user `c6bef167110b40519ff4e31456803b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:39:47.380652 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cb3e4c8b-33d6-4040-b4b9-140c7cd6acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:39:47.387857 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1430/2891] 10.222.0.46 () {58 vars in 967 bytes} [Thu Aug 4 05:39:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:39:47.428406 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401b7ea-22aa-40d8-b72f-455ec1f0da6e service placement] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:39:47.439515 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401b7ea-22aa-40d8-b72f-455ec1f0da6e service placement] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:39:47.445582 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f5f9d-7aa0-4b43-a200-fb19a07dd7ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ac376400a7466a8e01582efcb91f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:39:47.446173 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f5f9d-7aa0-4b43-a200-fb19a07dd7ee service swift] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:39:47.446482 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f5f9d-7aa0-4b43-a200-fb19a07dd7ee service swift] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:39:47.446754 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f5f9d-7aa0-4b43-a200-fb19a07dd7ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:39:47.454591 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f5f9d-7aa0-4b43-a200-fb19a07dd7ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:39:47.456613 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f5f9d-7aa0-4b43-a200-fb19a07dd7ee service swift] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:39:47.464381 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1462/2892] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Aug 4 05:39:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:39:55.002994 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e4c8b-33d6-4040-b4b9-140c7cd6acd2 None None] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:39:55.004624 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-cb3e4c8b-33d6-4040-b4b9-140c7cd6acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:39:55.020952 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e4c8b-33d6-4040-b4b9-140c7cd6acd2 None None] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:39:55.026289 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01b12-a4f9-4324-a1a5-26712bd5a6aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:39:55.026928 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01b12-a4f9-4324-a1a5-26712bd5a6aa service placement] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:39:55.027210 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01b12-a4f9-4324-a1a5-26712bd5a6aa service placement] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:39:55.027483 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01b12-a4f9-4324-a1a5-26712bd5a6aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:39:55.029318 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-53d01b12-a4f9-4324-a1a5-26712bd5a6aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:39:55.042127 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d01b12-a4f9-4324-a1a5-26712bd5a6aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:39:55.043753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d01b12-a4f9-4324-a1a5-26712bd5a6aa service placement] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:39:55.054659 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1431/2893] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:39:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:39:55.126182 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f5f9d-7aa0-4b43-a200-fb19a07dd7ee service swift] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:39:55.194138 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f5f9d-7aa0-4b43-a200-fb19a07dd7ee service swift] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:39:55.198633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:39:55.199290 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:39:55.199570 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:39:55.199847 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] PATH_INFO: `/v3/users/c8ff7be84ccd459cb7159bcffc1de249` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:39:55.201021 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ff7be84ccd459cb7159bcffc1de249)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:39:55.203010 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:39:55.436336 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ff7be84ccd459cb7159bcffc1de249'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:55.437033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ff7be84ccd459cb7159bcffc1de249'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:55.446596 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ff7be84ccd459cb7159bcffc1de249'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:55.460550 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ff7be84ccd459cb7159bcffc1de249'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:55.524947 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ff7be84ccd459cb7159bcffc1de249'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:55.531114 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1463/2894] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:39:55 2022] DELETE /identity/v3/users/c8ff7be84ccd459cb7159bcffc1de249 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:39:55.807118 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01b12-a4f9-4324-a1a5-26712bd5a6aa service placement] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:39:55.819340 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01b12-a4f9-4324-a1a5-26712bd5a6aa service placement] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:39:55.876305 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:39:55.876944 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:39:55.877223 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:39:55.878154 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] PATH_INFO: `/v3/projects/49ee5ac3fb644e24973f40ede2c94de7` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:39:55.879342 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ee5ac3fb644e24973f40ede2c94de7)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:39:55.881249 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:39:55.970572 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ee5ac3fb644e24973f40ede2c94de7', 'request_id': 'req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:55.977304 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ee5ac3fb644e24973f40ede2c94de7', 'request_id': 'req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.045030 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ee5ac3fb644e24973f40ede2c94de7', 'request_id': 'req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.059617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] The token cache is being invalidate because project 49ee5ac3fb644e24973f40ede2c94de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:39:56.059617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.059617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.059617 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1432/2895] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:39:55 2022] DELETE /identity/v3/projects/49ee5ac3fb644e24973f40ede2c94de7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:39:56.062996 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:39:56.064410 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:39:56.077952 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26dc02-18cf-4824-bffd-24c54fed8da7 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:39:56.137536 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:39:56.138185 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:39:56.139889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:39:56.139889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] PATH_INFO: `/v3/users/21788b45cb2b454a8145bc4281d4a66d` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:39:56.139889 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21788b45cb2b454a8145bc4281d4a66d)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:39:56.141925 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:39:56.149632 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:56.344334 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21788b45cb2b454a8145bc4281d4a66d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.344893 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21788b45cb2b454a8145bc4281d4a66d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.351772 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21788b45cb2b454a8145bc4281d4a66d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.365130 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21788b45cb2b454a8145bc4281d4a66d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.439159 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21788b45cb2b454a8145bc4281d4a66d'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.446294 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1464/2896] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:39:56 2022] DELETE /identity/v3/users/21788b45cb2b454a8145bc4281d4a66d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:39:56.692436 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:39:56.695550 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:39:56.706679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754d45-70ca-4710-92f3-d56b6e0ab5a0 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:39:56.763460 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:39:56.764095 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:39:56.764376 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:39:56.764649 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] PATH_INFO: `/v3/projects/8b9d2c1e38b64e8383b2640e2004fed8` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:39:56.765790 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b9d2c1e38b64e8383b2640e2004fed8)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:39:56.767724 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:39:56.779015 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:56.851455 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b9d2c1e38b64e8383b2640e2004fed8', 'request_id': 'req-82c572d8-ef6c-4bca-a752-be854c8bbf44'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.857596 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b9d2c1e38b64e8383b2640e2004fed8', 'request_id': 'req-82c572d8-ef6c-4bca-a752-be854c8bbf44'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.913461 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b9d2c1e38b64e8383b2640e2004fed8', 'request_id': 'req-82c572d8-ef6c-4bca-a752-be854c8bbf44'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.924206 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] The token cache is being invalidate because project 8b9d2c1e38b64e8383b2640e2004fed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:39:56.925303 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.926036 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:39:56.927570 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1433/2897] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:39:56 2022] DELETE /identity/v3/projects/8b9d2c1e38b64e8383b2640e2004fed8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:40:06.442586 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:06.921045 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:51.219005 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:40:51.220404 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:40:51.278641 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d0b2-2125-44bd-8c42-e0398811eff1 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:40:51.328610 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9524fa-d7b8-45e3-a79e-d1d8ab38f27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:40:51.329247 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9524fa-d7b8-45e3-a79e-d1d8ab38f27a service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:40:51.329522 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9524fa-d7b8-45e3-a79e-d1d8ab38f27a service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:40:51.329819 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9524fa-d7b8-45e3-a79e-d1d8ab38f27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:40:51.331561 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-be9524fa-d7b8-45e3-a79e-d1d8ab38f27a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:40:51.391939 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9524fa-d7b8-45e3-a79e-d1d8ab38f27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:40:51.393356 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9524fa-d7b8-45e3-a79e-d1d8ab38f27a service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:40:51.403171 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1465/2898] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:40:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:40:52.660753 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:40:52.662392 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:40:52.675498 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c572d8-ef6c-4bca-a752-be854c8bbf44 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:40:52.679298 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04978a07-f129-4965-92f1-9e728dca999b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:40:52.680087 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978a07-f129-4965-92f1-9e728dca999b service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:40:52.680371 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978a07-f129-4965-92f1-9e728dca999b service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:40:52.680643 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978a07-f129-4965-92f1-9e728dca999b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:40:52.682551 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-04978a07-f129-4965-92f1-9e728dca999b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:40:52.693910 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04978a07-f129-4965-92f1-9e728dca999b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:40:52.695879 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04978a07-f129-4965-92f1-9e728dca999b service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:40:52.704673 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1434/2899] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:40:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:40:52.944205 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9524fa-d7b8-45e3-a79e-d1d8ab38f27a service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:40:52.953731 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9524fa-d7b8-45e3-a79e-d1d8ab38f27a service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:40:52.957341 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca0681-c939-45af-91bd-6930c12ab486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:40:52.957940 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0681-c939-45af-91bd-6930c12ab486 service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:40:52.958216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0681-c939-45af-91bd-6930c12ab486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:40:52.958524 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0681-c939-45af-91bd-6930c12ab486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:40:52.960892 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a4ca0681-c939-45af-91bd-6930c12ab486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:40:53.035964 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=100 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:53.040633 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca0681-c939-45af-91bd-6930c12ab486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:40:53.042220 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca0681-c939-45af-91bd-6930c12ab486 service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:40:53.054295 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1466/2900] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:40:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:40:54.241639 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04978a07-f129-4965-92f1-9e728dca999b service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:40:54.250605 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04978a07-f129-4965-92f1-9e728dca999b service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:40:54.254255 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f3d95-6582-47af-8443-9b3af67d7afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:40:54.254886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f3d95-6582-47af-8443-9b3af67d7afd service neutron] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:40:54.255166 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f3d95-6582-47af-8443-9b3af67d7afd service neutron] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:40:54.255440 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f3d95-6582-47af-8443-9b3af67d7afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:40:54.257689 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-267f3d95-6582-47af-8443-9b3af67d7afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:40:54.271029 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f3d95-6582-47af-8443-9b3af67d7afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:40:54.272443 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f3d95-6582-47af-8443-9b3af67d7afd service neutron] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:40:54.284182 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1435/2901] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:40:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:41:03.089876 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=2 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:04.279276 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=12 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:06.061657 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca0681-c939-45af-91bd-6930c12ab486 service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:41:06.063103 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-a4ca0681-c939-45af-91bd-6930c12ab486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:41:06.074454 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca0681-c939-45af-91bd-6930c12ab486 service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:41:06.077984 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53793768-a8c5-4b0a-944b-4d4366a1e0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4213a478acfe4cc88df41b3da2d581ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:41:06.078608 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793768-a8c5-4b0a-944b-4d4366a1e0ed service neutron] REQUEST_METHOD: `GET` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:41:06.078882 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793768-a8c5-4b0a-944b-4d4366a1e0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:41:06.079150 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793768-a8c5-4b0a-944b-4d4366a1e0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:41:06.080824 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-53793768-a8c5-4b0a-944b-4d4366a1e0ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:41:06.142688 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53793768-a8c5-4b0a-944b-4d4366a1e0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:41:06.144099 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53793768-a8c5-4b0a-944b-4d4366a1e0ed service neutron] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:41:06.154060 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1467/2902] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:41:13.096895 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f3d95-6582-47af-8443-9b3af67d7afd service neutron] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:41:13.098329 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-267f3d95-6582-47af-8443-9b3af67d7afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:41:13.112719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f3d95-6582-47af-8443-9b3af67d7afd service neutron] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:41:13.117243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:41:13.118051 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:41:13.118510 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:41:13.118780 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] PATH_INFO: `/v3/users/5ffe04946139486bb4b976cb0503e0aa` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:41:13.119937 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffe04946139486bb4b976cb0503e0aa)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:41:13.121865 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:41:13.256975 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffe04946139486bb4b976cb0503e0aa'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:13.257629 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffe04946139486bb4b976cb0503e0aa'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:13.265213 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffe04946139486bb4b976cb0503e0aa'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:13.265886 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffe04946139486bb4b976cb0503e0aa'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:13.294948 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffe04946139486bb4b976cb0503e0aa'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:13.312755 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1436/2903] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:41:13 2022] DELETE /identity/v3/users/5ffe04946139486bb4b976cb0503e0aa => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:41:13.565775 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53793768-a8c5-4b0a-944b-4d4366a1e0ed service neutron] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:41:13.577659 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53793768-a8c5-4b0a-944b-4d4366a1e0ed service neutron] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:41:13.637050 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:41:13.637685 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:41:13.637962 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:41:13.638234 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] PATH_INFO: `/v3/projects/c37bea771e9a4c26a19ff2ea9ed9d9b4` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:41:13.639409 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37bea771e9a4c26a19ff2ea9ed9d9b4)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:41:13.641289 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:41:13.763291 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'request_id': 'req-840ca813-04df-4e13-bb04-d323aa4200f6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:13.769769 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'request_id': 'req-840ca813-04df-4e13-bb04-d323aa4200f6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:13.832531 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'request_id': 'req-840ca813-04df-4e13-bb04-d323aa4200f6'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:13.844922 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] The token cache is being invalidate because project c37bea771e9a4c26a19ff2ea9ed9d9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:41:13.846734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:13.846734 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:13.847321 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1468/2904] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:41:13 2022] DELETE /identity/v3/projects/c37bea771e9a4c26a19ff2ea9ed9d9b4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:41:13.851334 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:41:13.853482 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:41:13.866243 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a467-1167-4315-a37e-ee955bffe718 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:41:13.924277 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:41:13.924836 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:41:13.925115 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:41:13.925388 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] PATH_INFO: `/v3/users/8093fe4e20804367ba3bdd3fd339266f` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:41:13.926588 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8093fe4e20804367ba3bdd3fd339266f)` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:41:13.928515 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:41:14.122145 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8093fe4e20804367ba3bdd3fd339266f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:14.122912 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8093fe4e20804367ba3bdd3fd339266f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:14.132308 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8093fe4e20804367ba3bdd3fd339266f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:14.132980 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8093fe4e20804367ba3bdd3fd339266f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:14.204109 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.notifications [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8093fe4e20804367ba3bdd3fd339266f'} {{(pid=80699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:14.213320 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:14.223346 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1437/2905] 10.222.0.46 () {58 vars in 1224 bytes} [Thu Aug 4 05:41:13 2022] DELETE /identity/v3/users/8093fe4e20804367ba3bdd3fd339266f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:41:14.443691 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] Authenticating user token {{(pid=80698) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:41:14.445117 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.fernet_utils [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80698) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:41:14.458839 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ca813-04df-4e13-bb04-d323aa4200f6 admin admin] Validating token access rules against request {{(pid=80698) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:41:14.480094 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:14.516881 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b3532d53944d4789f9bd6bd6ab00cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fa97262e904ea29696d2d9cb8b9bc3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80698) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:41:14.517518 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:41:14.517799 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:41:14.518075 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] PATH_INFO: `/v3/projects/625e0253dfcc47d6ba486169e52ee801` {{(pid=80698) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:41:14.519265 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625e0253dfcc47d6ba486169e52ee801)` {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:41:14.521187 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] RBAC: Authorization granted {{(pid=80698) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:41:14.604033 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625e0253dfcc47d6ba486169e52ee801', 'request_id': 'req-4f17ea81-f457-4dca-bab5-42d2541951e9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:14.610206 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625e0253dfcc47d6ba486169e52ee801', 'request_id': 'req-4f17ea81-f457-4dca-bab5-42d2541951e9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:14.678155 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625e0253dfcc47d6ba486169e52ee801', 'request_id': 'req-4f17ea81-f457-4dca-bab5-42d2541951e9'} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:14.688933 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] The token cache is being invalidate because project 625e0253dfcc47d6ba486169e52ee801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80698) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:41:14.689216 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:14.689860 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG keystone.notifications [None req-4f17ea81-f457-4dca-bab5-42d2541951e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80698) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:41:14.691491 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: [pid: 80698|app: 0|req: 1469/2906] 10.222.0.46 () {58 vars in 1233 bytes} [Thu Aug 4 05:41:14 2022] DELETE /identity/v3/projects/625e0253dfcc47d6ba486169e52ee801 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:41:24.300957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:41:24.685911 dv-cinder-852072-1-iscsi devstack@keystone.service[80698]: DEBUG dbcounter [-] [80698] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:44:18.803957 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] Authenticating user token {{(pid=80699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:44:18.805450 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:44:18.945563 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd647e0-8d45-4630-a5d9-e9df4905c1b0 admin admin] Validating token access rules against request {{(pid=80699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:44:19.004063 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84472d-9f47-4937-8391-1ce9c68b4b8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448d43be14a74865a1e0d09e76c7e248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e168d6f8f6142bdaad5e1f6bb544328', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:44:19.004679 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84472d-9f47-4937-8391-1ce9c68b4b8a service placement] REQUEST_METHOD: `GET` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:44:19.004954 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84472d-9f47-4937-8391-1ce9c68b4b8a service placement] SCRIPT_NAME: `/identity` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:44:19.005299 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84472d-9f47-4937-8391-1ce9c68b4b8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:44:19.007199 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.fernet_utils [None req-1e84472d-9f47-4937-8391-1ce9c68b4b8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:44:19.018105 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84472d-9f47-4937-8391-1ce9c68b4b8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:44:19.019719 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84472d-9f47-4937-8391-1ce9c68b4b8a service placement] RBAC: Authorization granted {{(pid=80699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:44:19.029981 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: [pid: 80699|app: 0|req: 1438/2907] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Aug 4 05:44:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:44:29.025681 dv-cinder-852072-1-iscsi devstack@keystone.service[80699]: DEBUG dbcounter [-] [80699] Writing DB stats keystone:SELECT=89 {{(pid=80699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}